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© The present invention is to provide a decoder 
which detects a start code in a layered coded data 
stream on a layer basis for improving an error de- 
tecting function to reduce possible damaging effects, 
and replaces a detected start code with minor error 
by an appropriate start code to maintain decoding. 

The decoder includes a unique pattern detector 
which detects a start code pattern in a layered 
coded data stream, a start code identifier which 
identifies the detected start code pattern based on a 
given condition, a similarity calculator which cal- 
culates similarity as an evaluation between the error 
detected start code pattern and an expected start 
code based on layer, and a similarity based replace- 
ment identifier which replaces the error detected 
start code pattern by the most appropriate replace- 
ment selected based on the similarity based evalu- 
ation, and otherwise the priority based replacement 
identifier which selects a replacement by the priority 
order. 
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BACKGROUND OF THE INVENTION 

1 . Held of the invention 

The present invention relates to a data receiv- 5 
ing method and apparatus, and more specifically to 
a decoder which deals with a coded data stream in 
a regularly organized layered structure of user in- 
formation including video, audio, data and so forth. 

70 

2. Description of the Related Art 

It has been a common practice to use a start 
code as a signal for synchronization or for execu- 
tion startup of a process. Successful detection of a 75 
start code in a data stream has long been a chal- 
lenge. It is also important to deal successfully with 
a situation where a start code pattern is detected 
by error and, particularly, to maintain a decoding 
operation without interruption by an error detection. 20 
However, no effective and satisfactory research has 
been conducted in this field. 

Japanese Unexamined Patent Publication 
No.2881 29/1 989 discloses a conventional system 
which tries to detect a start code of a fixed bit 25 
pattern within a maximum detection tolerable error 
of one-bit. The conventional art is designed to 
avoid an error-related suspension of decoding op- 
erations when a one-bit error pattern of a start code 
is detected. 30 

Fig. 37 is a block diagram of a start code 
detector according to the conventional art. The 
start code detector comprises a bit pattern com- 
parator 51 and a start code pattern generator 53. 
The bit pattern comparator 51 receives an incom- 35 
ing bit stream 50 and outputs a data effective 
signal 52. The start code pattern generator 53 
issues a start code pattern 54. 

The conventional start code detector of Fig. 37 
tries to detect a start code successfully by using 40 
an error detection evading method with an error 
detection tolerable capacity of one bit in the follow- 
ing manner. The bit pattern comparator 51 con- 
stantly watches incoming bits on an incoming bit 
stream 50 to detect a start code. Fig. 38 shows a 45 
list of five-bit patterns including a start code 
"11010", for example, to be detected and its one- 
bit error patterns within the detection tolerable 
maximum capacity of one bit error. These one-bit 
error patterns differ from the start code pattern by 50 
one bit in different bit positions of the five-bit 
pattern. 

The start code pattern generator 53 presents 
all the patterns in Fig. 38, for example, to the bit 
pattern comparator 51 for comparison. When a bit 55 
pattern on incoming data stream 50 is recognized 
as one of the patterns in Fig. 38, the bit pattern 
comparator 52 issues the data effective signal 52 
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for an effective period of the corresponding data. 

Thus, the error detection evading method im- 
plemented in the conventional start code detector 
works with the detection tolerable capacity of one 
bit error. The conventional start code detector can 
perform a successful detection of a start code if the 
start code is erroneous by no more than one bit. In 
other words, an incoming bit pattern is examined 
not only with a correct start code pattern but with 
all of its one-bit error patterns in order to success- 
fully detect a start code with a maximum of a one- 
bit error in its bit pattern. 

The error detection may lead to a suspension 
of an operation. In this respect, the conventional 
start code detector is effective to evade error de- 
tection in a bit stream. However, the conventional 
start code detector is effective only under the spe- 
cific condition that a single type of start code of 
fixed-bit length is used in the data stream. The 
conventional method of evading error detection can 
deal only with a single type of start code provided 
in a bit stream. Consequently, the conventional 
start code decoder cannot effectively deal with a 
data stream with two or more types of start codes 
which are to be detected or identified. 

For example, a start code is defined as a 
specific coded word and used as a start delimiter 
of a layer as well as a starter of data in a coded 
data stream organized based on a digital video 
compression method which is prescribed in 
ISO/IEC 11172-2 (MPEG-1 video). This type of 
coded data stream contains two or more types of 
32-bit start codes, each of which consists of a start 
code prefix followed by a start code value. The 
start code prefix is a string of unique twenty four 
. bits which indicates a start code. The start code 
value is a string of eight bits which identifies the 
type of start code. 

A start code in this type of coded data stream 
is detected or identified by recognizing the type of 
start code by the eight-bit start code value after 
detecting the unique twenty-four-bit start code pre- 
fix. The conventional detection error evading meth- 
od with a detection tolerable capacity of one-bit 
error may be used to detect the unique start code 
prefix. However, the conventional method is of no 
use for the detection of a start code value which 
can be a plurality of values, some of which differ 
from one another by one bit. Application of the 
conventional method to a start code detection with 
this coded data stream may cause serious decod- 
ing damage in a decoder. 

In the view of the foregoing problems, it is an 
object of the present invention to provide a de- 
coder for decoding data in a coded data stream 
which can minimize video data damage by error 
detection of a start code or specific code word. 
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It is another object of the present invention to 
provide a decoder which tries to maintain an opera- 
tion when detecting a start code or specific code 
word with minor or bit error by using the most 
similar replacement to the detected code of others. 

It is a further object of the present invention to 
provide a decoder which can mask an error by 
limiting the area and period of error masking on the 
display when a detected error start code cannot be 
replaced. 

It is a further object of the present invention to 
provide a data receiving apparatus which can mini- 
mize damage to video data by error detection. 

It is a further object of the present invention to 
realize a data receiving method for minimizing error 
detection which can be implemented in a decoder 
for decoding data in a data stream or in a data 
receiving apparatus. 

SUMMARY OF THE INVENTION 

These and other objects are accomplished by 
the following aspects of the present invention. 

According to one aspect of the present inven- 
tion, an apparatus for receiving and decoding a bit 
stream of data blocks which are organized in a 
hierarchical order of layers, each of the data blocks 
corresponding to one of the layers and including a 
start code which identifies the layer of the data 
block may include a layer memory for storing data 
indicating the layer corresponding to the last start 
code received in the data stream, the layer mem- 
ory having a last layer output, a start code detec- 
tor, coupled to receive the bit stream and the last 
layer output, for detecting start codes by compar- 
ing data in the bit stream with a set of expected 
start codes, the set of expected start codes being 
selected responsive to the last layer output, the 
start code detector selecting one of the expected 
start codes as a detected start code, if one of the 
expected start codes is acceptably similar to data 
in the bit stream, the start code detector having a 
start code detector output which identifies the de- 
tected start code and its corresponding layer, 
means responsive to the start code detector output 
for updating the layer memory with data indicating 
the layer corresponding to the detected start code, 
and a block data decoder, responsive to the de- 
tected start code output from the start code detec- 
tor, for decoding the data block corresponding to 
the detected start code. 

The start code detector may include a unique 
pattern detector coupled to receive the bit stream 
and detect start code prefixes, the unique pattern 
detector having an output on which possible start 
codes corresponding to detected start code pre- 
fixes are placed, and a start code identifier, coup- 
led to receive the output of the unique pattern 



detector and the last layer output from the layer 
memory, for comparing the possible start codes 
from the unique pattern detector with one or more 
expected start codes based on the last layer out- 

5 put, the start code identifier having a start code 
identifier output in a first state which indicates that 
an error has occurred, if no expected start code is 
acceptably similar to the possible start code, and in 
a second state which identifies the detected start 

w code and the corresponding layer, if an expected 
start code is acceptably similar to the possible start 
code. 

The block data decoder is responsive to the 
start code identifier output being in the first state 

75 for suspending block data decoding, and the ap- 
paratus may further include a display controller, the 
display controller responsive to the start code iden- 
. tifier output being in the first state to perform error 
masking corresponding to the error. 

20 ,The apparatus may further include means for 
instructing the display controller to cease the error 
masking and instructing the block data decoder to 
resume block data decoding when the start code 
identifier next detects a start code corresponding to 

25 a layer which is the same as or higher in the layer 
hierarchy. 

The start code detector may include a unique 
pattern detector coupled to receive the bit stream 
and detect start code prefixes, the unique pattern 

30 detector having a unique pattern detector output on 
which possible start codes corresponding to de- 
tected start code prefixes are placed, a first ex- 
pected start code selector coupled to receive the 
last layer output from the layer memory, the first 

35 expected start code selector selecting and generat- 
ing a first expected start code selector output iden- 
tifying one or more expected start codes based on 
the last layer, a start code matching identifier, 
coupled to receive the unique pattern detector out- 

40 put and the first expected start code selector out- 
put, for comparing the possible start code from the 
unique pattern detector with the one or more ex- 
pected start codes based on the last layer output, 
the start code matching identifier generating a re- 

45 placement start signal output if the possible start 
code does not match any of the expected start 
codes, and a start code replacement unit, respon- 
sive to the replacement start signal output. The 
start code replacement unit may include a second 

so expected start code selector for selecting one or 
more expected start codes based on the last layer, 
and generating an output indicating the expected 
start codes, a similarity calculator, coupled to re- 
ceive expected start codes from the second ex- 
55 pected start code selector and the possible start 
code, for calculating and generating an output in- 
dicating a Hamming distance of the possible start 
code to each of the expected start codes from the 
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second expected start code selector, and a similar- 
ity based replacement identifier, coupled to receive 
the output of the similarity calculator, for selecting 
and generating a start code identifier output in- 
dicating the one of the expected start codes with 
the smallest Hamming distance to the possible 

start code. , , 

The Hamming distances may be calculated by 
determining the number of bits of each of the 
expected start codes which do not match the cor- 
responding bit of the possible start code. 

The Hamming distances may be calculated for 
each expected start code by determining each bit 
of the expected start code which does not match 
the corresponding bit of the detected start code, 
weighting each of the bits based on its bit position 
to generate a weighted bit value and summing all 
of the weighted bit values. 

The start code detector may include a unique 
pattern detector coupled to receive the bit stream 
and detect start code prefixes, the unique pattern 
detector having a unique pattern detector output on 
which possible start codes corresponding to de- 
tected start code prefixes are placed, a first ex- 
pected start code selector coupled to receive the 
last layer output from the layer memory, the ex- 
pected start code selector selecting and generating 
a first expected start code selector output identify- 
ing one or more expected start codes based on the 
last layer output, a start code matching identifier, 
coupled to receive the unique pattern detector out- 
put and the first expected start code selector out- 
put, for comparing the possible start code from the 
unique pattern detector with the one or more ex- 
pected start codes based on the last layer output, 
the start code matching identifier generating a re- 
placement start signal output if the possible start 
code does not match any of the expected start 
codes, and a start code replacement unit, respon- 
sive to the replacement start signal output. The 
start code replacement unit may include a second 
expected start code selector for selecting one or 
more expected start codes based on the last layer 
and generating an output indicating the expected 
start codes, a priority assigning numerator, coupled 
to receive expected start codes from the second 
expected start code selector and to receive the last 
layer output, for calculating and generating an out- 
put indicating a probability of occurrence for each 
expected start code received from the second ex- 
pected start code selector, and a priority based 
replacement identifier, coupled to receive the out- 
put of the priority assigning numerator, for select- 
ing and generating a start code identifier output 
indicating the one of the expected start codes with 
the highest probability of occurrence. 

The priority assigning numerator output may 
indicate priority of each expected start code by a 



numerical value based on probability of occurrence 
relative to other expected start codes. 

The priority assigning numerator output may 
indicate priority of each expected start code by its 
s order of probability from most likely to least likely 
relative to other expected start codes without in- 
dicating actual probability of occurrence. 

The start code detector may include a replace- 
ment determiner for selecting a detected start code 
to from the expected start codes, the replacement 
determiner locally decoding the block data for a 
predetermined time period in accordance with a 
plurality of the expected start codes and detecting 
the number of decoding errors for the block data 
15 for each of the plurality of expected start codes 
and selecting as the detected start code a one of 
the plurality of expected start codes in which the 
fewest decoding errors were detected. 

According to another aspect of the present 
20 invention, 3 method for receiving -and decoding a 
bit stream of data blocks which are organized in a 
hierarchical order of layers, each of the data blocks 
corresponding to one of the layers and including a 
start code which identifies the layer of the data 
25 block. The method may include the steps of storing 
data indicating the layer corresponding to the last 
start code received in the data stream, continu- 
ously comparing data in the bit stream with a set of 
expected start codes, the set of expected start 
30 codes being selected responsive to the last layer, 
selecting one of the expected start codes as a 
detected start code based on the comparison, if 
one of the expected start codes is acceptably 
similar to data in the bit stream, updating the last 
35 layer data with data indicating the layer corre- 
sponding to the detected start code, and decoding 
the block data corresponding to the detected start 
code in accordance with the detected start code. 
The comparing step may include detecting 
40 start code prefixes in the bit stream, and compar- 
ing start codes corresponding to the prefixes with 
one or more of the expected start codes. 

The method may further include the steps of 
suspending block data decoding if a detected start 
45 code is not selected, and performing error masking 
if a detected start code is not selected. 

The method may further include the step of 
ceasing the error masking and resuming block data 
decoding when a start code is detected corre- 
50 sponding to a layer which is the same as or higher 
in the layer hierarchy than the layer in which no 
selection was made. 

The selecting step may include generating a 
replacement start signal if one of the expected start 
55 codes does not match the start code corresponding 
to the detected start code prefix, selecting one or 
more expected start codes based on the last layer, 
calculating a Hamming distance of the start code 
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corresponding to the detected start code prefix to 
each of the expected start codes, and selecting as 
the detected start code a one of the expected start 
codes with the smallest Hamming distance to the 
start code corresponding to the detected start code 5 
prefix. 

The Hamming distance calculating step in- 
cludes the step of determining the number of bits 
of each of the expected start codes which do not 
match the corresponding bit of the start code cor- 10 
responding to the detected start code prefix. 

The Hamming distance calculating step for 
each expected start code may include the steps of 
determining for each expected start code, each bit 
of the expected start code which does not match 15 
the corresponding bit of the start code correspond- 
ing to the detected start code prefix, weighting 
each of the bits based on its bit position to gen- 
erate a weighted bit value, and summing all of the 
weighted bit values. .20 

The method may further include the step of 
calculating a probability of occurrence for each 
expected start code if no expected start code iden- 
tically matches the start code corresponding to the 
detected start code prefix, and selecting a one of 25 
sid expected start codes with the highest probabil- 
ity of occurrence as the detected start code. 

The selecting step may include the steps of 
generating a replacement start signal if one of the 
expected start codes does not match the start code 30 
corresponding to the detected start code prefix, 
selecting one or more expected start codes based 
on the last layer output, calculating a Hamming 
distance of the start code corresponding to the 
detected start code prefix to each of the expected 35 
start codes, calculating a probability of occurrence 
for each expected start code if no expected start 
code identically matches the start code corre- 
sponding to the detected start code prefix, and 
selecting as the detected start code a one of the 40 
expected start codes with the smallest value of W, 
where, 

W = D[Pi(L)] - E[Pi(L)] 

45 

where 

Pi(L) is an expected start code 
D[Pi(L)] is the Hamming distance of the start 
code, and 

E[Pi(L)] is the probability of occurrence of the so 
expected start code. 

The selecting step may include the steps of 
locally decoding block data corresponding to a 
detected start code prefix for a predetermined time 
period in accordance with a plurality of the ex- 55 
pected start codes, detecting the number of decod- 
ing errors for the block data for each of the plurality 
of expected start codes, and selecting as the de- 



tected start code a one of the plurality of expected 
start codes in which the fewest decoding errors 
were detected. 

BRIEF DESCRIPTION OF THE DRAWINGS 

In the drawings; 
Fig. 1 illustrates a decomposition of a video 
sequence of MPEG-1 video data to be decoded 
in a decoder of the present invention according 
to one embodiment; 

Fig. 2 shows a bit stream organization of the 

MPEG-1 video data in Fig. 1; 

Fig. 3 shows a part of the MPEG-1 video bit 

stream in Fig. 2 in more detail; 

Fig. 4 shows a list of start codes which occur in 

a bit stream of the MPEG-1 video data in Fig. 2 

or 3; 

Fig. 5 shows a block diagram of the decoder 
according to this embodiment; 
Fig. 6 shows a block diagram of a header ana- 
lyzer of the decoder in Fig. 5; 
Fig. 7 shows a block diagram of a start code 
detector in the header analyzer of Fig. 6; 
Fig. 8 shows a list of start codes to be detected 
in the decoder in Fig. 5; 

Fig. 9 shows a block diagram of a start code 
identifier in the start code detector of Fig. 7; 
Fig. 10 shows a table of layer based expected 
start codes to be detected in the decoder of Fig. 
5; 

Fig. 11 shows the contents of a header to be 
analyzed in the header analyzer of Fig. 6; 
Fig. 12 shows layer based different cases of 
error detection in a bit stream of MPEG-1 video 
data illustrating the possible cases of resynch- 
ronization in accordance with a layer of error 
detection in the decoder of Fig. 5 according to 
this embodiment; 

Fig. 13 is a flowchart illustrating a start code 
detecting and identifying operation in the start 
code detector according to this embodiment; 
Fig. 14 is a flowchart illustrating a resynch- 
ronizing operation of S10 in Fig. 13 according to 
this embodiment; 

Fig. 15 shows a block diagram of a start code 
detector in a header analyzer of a decoder of 
the present invention according to another em- 
bodiment; 

Fig. 16 shows a block diagram of a start code 
replacement unit in the start code detector of 
Fig. 15; 

Fig. 17 shows a block diagram of a similarity 
calculator for calculating a code distance in the 
start code replacement unit of Fig. 16; 
Fig. 18 is a flowchart illustrating a start code 
detecting and identifying operation in the a start 
code detector according to this embodiment; 
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Fig. 19 is a flowchart illustrating a start code 
replacement operation in S20 in Fig. 18 accord- 
ing to this embodiment; 

Fig. 20 shows a block diagram of a start code 
replacement unit in a start code detector in a s 
decoder of the present invention according to 
another embodiment; 

Fig. 21 shows a block diagram of a priority 
assigning numerator for evaluating probability of 
occurrence to layer based expected start codes 10 
by assigning priority orders in the start code 
replacement unit of Fig. 20; 
Fig. 22 shows an evaluation memory table of 
expectation of occurrence of layered expected 
start codes in the priority assigning numerator in 75 
Fig. 21 according to this embodiment; 
Fig. 23 shows another example of the evaluation 
memory table in Fig. 22 according to this em- 
bodiment; 

Fig. 24 shows another example of the evaluation 20 
memory table in Fig. 22 according to this em- 
bodiment; 

Fig. 25 shows an evaluation memory table of 
expectation of occurrence in priority order of 
layer based expected start codes in a priority 25 
assigning numerator in a decoder of the present 
invention according to another embodiment; 
Fig. 26 shows a block diagram of a start code 
replacement unit in a start code detector in a 
decoder of the present invention according to 30 
another embodiment; 

Fig. 27 shows a block diagram of a replacement 
identifier in a start code replacement unit in a 
decoder of the present invention according to 
another embodiment; 35 
Fig. 28 shows a block diagram of a priority 
assigning numerator for evaluating probability of 
occurrence of layer based expected start codes 
in a start code replacement unit in a decoder of 
the present invention according to another em- 40 
bodiment; 

Fig. 29 shows a block diagram of a start code 
replacement unit in a start code detector in a 
decoder of the present invention according to 
another embodiment; 45 
Fig. 30 shows a table of decoding period time 
required for data in different layers according to 
this embodiment; 

Fig. 31 shows a block diagram of a start code 
detector in a decoder of the present invention 50 
according to another embodiment; 
Fig. 32 is a flowchart illustrating a replacement 
control in a replacement controller in the start 
code detector in Fig. 31 according to this em- 
bodiment; 55 
Fig. 33 shows a list of layer based expected 
start codes which occur in a bit stream of 
MPEG-2 video data to be detected in a decoder 



of the present invention according to another 
embodiment; 

Fig. 34 shows a bit stream organization of 
MPEG-1 system data to be decoded in a de- 
coder of the present invention according to an- 
other embodiment; 

Fig. 35 shows a table of layer based expected 
start codes in the bit stream of MPEG-1 system 
data in Fig. 34 according to this embodiment; 
Fig. 36 shows different possible types of a regu- 
larly organized layered structure in a bit stream 
according to another embodiment of the present 
invention; 

Fig. 37 shows a block diagram of a start code 
detector of a conventional decoder for detecting 
only a single type of start code of fixed-bit 
length; and 

Fig. 38 shows a list of start code patterns within 
a detection tolerable capacity of one-bit error 
■. according to a conventional start cpde detection 
method. 

DETAILED DESCRIPTION OF PREFERRED EM- 
BODIMENTS OF THE INVENTION 

Embodiment 1 . 

Fig. 1 shows a decomposition of a video se- 
quence of MPEG-1 video data with different data 
elements in layers. A decoder of the present inven- 
tion is intended primarily to decode digital video 
data in a layered bit stream according to the meth- 
od prescribed by ISO/IEC 11172-2 (MPEG-1). 

With reference to Fig. 1, a video sequence 
consists of one or more groups of pictures or 
GOPs. A GOP is a series of one or more pictures. 
A picture contains one or more slices. A slice is a 
series of two or more macroblocks. A macroblock 
is a plurality of blocks. Thus, digital video data are 
organized by hierarchical levels of data or in layers. 
A top level in hierarchy in the video sequence is a 
sequence layer. The next level in the hierarchy is a 
GOP layer followed by a picture layer. A picture 
layer is followed by a slice layer. A macroblock 
layer follows a slice layer and the lowest level in 
the hierarchy is a block layer following a macro- 
block layer. 

A bit stream of coded video data decoded in 
the inventive decoder is organized in layers based 
on this hierarchy as shown in Figs. 2 and 3. 

Referring to Fig. 2, a bit stream is a series of 
one or more consecutive sequence layers. As the 
figure shows, a sequence layer includes all of the 
lower layers. The other layers include all of their 
lower layers based on the layered organization of a 
bit stream stated above. 

Fig. 3 details the layered bit stream in Fig. 2 
illustrating different types of start codes and head- 
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ers corresponding to different layers. As the figure 
illustrates, each layer commences with a start code 
as a specific code word, except for macroblock and 
block layers which contain no start codes. A bit 
stream or a sequence layer commences with a 

sequence header with a sequence start__code in 

the front. A GOP layer commences with a GOP 
header with a group__start__code in the front. A 
picture layer commences with a picture header 

with a picture start__code in the front. A slice 

layer commences with a slice header with a 

slice start__code in the front. Finally, a bit stream 

is ended with a sequence end_code. Fig. 4 is a 

list of start codes which may occur in a bit stream 
and their bit strings in hexadecimal including the 

sequence_end code. Referring to the figure, 

there are two types of start codes which are not 
illustrated in the layered bit stream in Fig. 3, an 

extension__data start_code and a 

user data__start_code, with which extension data 

and user data are commenced respectively. These 
data can be predefined as required in each of the 
sequences, GOP and picture layers for providing 
optional data. 

Consequently, a layered bit stream of MPEG-1 
video data is organized under such a consistent 
form that incoming data can be predicted in a bit 
stream. Specifically, sequence data can be fol- 
lowed by GOP data, extension data or user data. 
GOP data can be followed by picture data, exten- 
sion data or user data. Picture data can be followed 
by slice data, extension data or user data. Slice 
data can be followed by slice data, picture data, 
GOP data or sequence data. No other data can 
occur in a bit stream of MPEG-1 video data. 

Fig. 5 shows a block diagram of a decoder 
according to one embodiment of the present inven- 
tion. Referring to the figure, the decoder has a 
preprocessor 2, a header analyzer 4, a block-data 
decoder 7, a controller 10, a display controller 11, 
a memory 12, and a digital/analog (D/A) converter 
13. An incoming bit stream 1 is input to the de- 
coder through an external transmission line. The 
preprocessor 2 outputs preprocessed data 3. The 
header analyzer 4 outputs layer information 5. The 
block-data decoder 7 outputs digital video data 9. 
The controller 10 controls operations in the de- 
coder. The D/A converter 13 outputs analog video 
data 1 4. A solid line with an arrow or arrows in the 
figure indicates a direction or directions of a data 
flow. A dashed line with an arrow or arrows in- 
dicates a direction or directions of the flow of a 
control signal. 

Fig. 6 shows a block diagram of the header 
analyzer 4 in Fig. 5. Referring to Fig. 6, the header 
analyzer 4 has a start code detector 15, a header 
information decoder 16 and a layer memory 17. 
The header information decoder 16 decodes a se- 



ries of data in each header of a sequence header, 
a GOP header, a picture header and a slice header 
and macroblock data except block data. 

A series of decoding operations performed in 
5 the inventive decoder of this embodiment are now 
described with reference to Figs. 5 and 6. 

When input data in the incoming bit stream 1 
through a transmission line, the preprocessor 2 
buffers a certain amount of bits of the data. The 

10 preprocessor 2 then adjusts a processing speed for 
the buffered bits by absorbing a speed difference 
between a transmission speed with which the bits 
are transmitted and a decoding speed with which 
the bits will be processed in the decoder. The 

75 preprocessor 2 also separates a processing unit of 
fixed-bit pattern or the preprocessed data 3 from 
the buffered bits in accordance with a control sig- 
nal from the controller 10. The preprocessed data 3 
is output to the header analyzer 4 and the block- 

20 data decoder 7. 

An operation of the decoder starts when the 
sequence start code, a start delimiter of a se- 
quence layer, is detected in the header analyzer 4 
after the decoder has been initialized or a software 

25 is reset. 

In a normal decoding operation, the start code 
detector 15 in the header analyzer 4 constantly 
watches the preprocessed data 3 to detect a start 
code. When a start code is detected and identified 

30 by the type, the start code detector 15 issues layer 
information 19 and start code information 20 based 
on a detected start code. The layer information 1 9 
is input to the layer memory 17 for storage and 
also to the header information decoder 16 for in- 

35 forming of the type of layer of the detected start 
code. The start code information 20 is input in the 
header information decoder 16 to inform of the 
type of start code detected. The header information 
decoder 16 decodes header data elements of the 

40 preprocessed data 3 corresponding to the detected 
start code based on the layer information 19 and 
the start code information 20. Consequently, the 
header information decoder 16 outputs decoded 
header information 6. The decoded header informa- 

45 tion 6 can be used as required in the controller 10 
or other units in the decoder for controlling decod- 
ing or displaying. 

When completed decoding of a series of head- 
er data from a sequence header through a slice 

50 header in a bit stream, the header information 
decoder 16 issues a header decoding end signal 
21 to the start code detector 15 and the controller 
10. In reception of the header decoding end signal 
21, the controller 10 starts the block-data decoder 

55 7 when receiving the header decoding end signal 
21 . The block-data decoder 7 decodes digital video 
data in the preprocessed data 3 corresponding to 
the header information analyzed in the header ana- 



7 



13 



EP 0 651 584 A2 



14 



lyzer 4 based on a MPEG-1 video reconstruction 
algorithm. Consequently, decoded digital video 
data 9 in the block-data decoder 7 are stored in the 
memory 12 and can be read as required by the 
block-data decoder 7 or the display controller 1 1 . A 
series of normal decoding operations discussed 
here are executed in synchronization. 

When a start code pattern with a substantial 
error (i.e., an error of sufficient magnitude that a 
normal decoding operation is not maintainable) is 
detected, the start code detector 15 informs the 
controller 10 by a control signal. Further, the start 
code detector 15 informs the controller 10 of the 
layer in which the substantial error was detected. 
The layer in which the substantial error was de- 
tected can be informed by latest layer information 
18 which is stored in the layer memory 17 of the 
previously detected start code. When a substantial 
error is detected by the start code detector 15, the 
controller. 10 assumes that the start code detector 
15 has been desynchronized and resets the syn- 
chronization of the decoder 15 based on the layer 
with the substantial error or the latest layer informa- 
tion 18. Further, the controller 10 requests the 
display controller 11 to give an optimal error mask- 
ing to the corresponding area of the video image in 
a frame on the display which is based on the layer 
in which the substantial error detection occurred 
until the decoder recovers proper synchronization. 

Synchronization can be recovered through the 
following process: The start code detector 15 se- 
lects start codes as a signal for synchronization 
based on a layer in which a substantial error was 
detected. The start code detector 15 discards all 
the subsequent data until the selected start codes. 
In the meantime, all the decoding operations in the 
decoder are suspended. The display controller 11 
continues the optimal error masking for an error 
area required by the controller 10. A detailed dis- 
cussion of the resynchronization will be made later. 

Fig. 7 shows the start code detector 15 in the 
header analyzer 4 in Fig. 6. Referring to the figure, 
the start code detector 15 has a unique pattern 
detector 22, a start code identifier 24 and a start 
code pattern generator 25. The unique pattern de- 
tector 22 detects unique bit patterns in the 
preprocessed data 3 output from the preprocessor 
2. Fig. 8 shows start codes of start delimiters of 
layers listed in Fig. 4. The start code detector 15 is 
to detect all types of start codes listed in Fig. 4. 

The unique pattern detector 22 watches incom- 
ing bits of the preprocessed data 3 to detect a 
unique 24-bit pattern "000001 in hexadecimal" or a 
start code prefix, indicating a start code, common 
to all types of start codes in Fig. 4. If the unique 
pattern detector 22 does not detect a start code 
prefix, it discards the preprocessed data 3 and 
observes the next incoming bits of the preproces- 



sed data 3 for a start code prefix. 

When the unique pattern detector 22 detects 
the unique 24-bit pattern in the incoming bits of the 
preprocessed data 3, it sends to the start code 

5 identifier 24 as a start code candidate 23 a 32-bit 
start code pattern comprising the detected unique 
24-bit pattern followed by an eight-bit pattern. 

The start code identifier 24 compares the 
eight-bit pattern of the start code candidate 23 with 

70 a start code pattern 26 generated in the start code 
pattern generator 25. As a result, the start code 
identifier 24 identifies the start code candidate 23 
as one of the start codes listed in Fig. 4. Further, 
the start code identifier 24 examines and decides 

ts the propriety of the identified start code based on 
the place in the bit stream that the start code is 
detected. 

The identified start code should be appropriate 
if it is the sequence^ start code detected in an 

20 initialized stage or a reset stage of the decoder. 
The identified start code should be appropriate, 
otherwise, if it is one of the start codes listed in 
Fig. 8 of a start delimiter of layer when detected in 
a normal operation of the start code detector 24. 

25 A start code identifying operation in the start 

code identifier 24 will be discussed later in more 
detail. 

When the identified start code is appropriate, 
the start code identifier 24 finally issues layer in- 

30 formation 19 and start code information 20 based 
on the identified start code. The layer information 
19 is input and stored in the layer memory 17 and 
also input in the header information decoder 16. 
The start code information 20 is input in the header 

35 information decoder 16. Consequently with these 
two pieces of information, the header information 
decoder 16 starts its operation. 

When a start code is detected with a substan- 
tial error, the start code identifier 24 informs the 

40 controller 10 by a control signal of the substantial 
error, with which a normal decoding operation will 
not be maintained, and of the layer where the 
substantial error occurred. 

Now, a series of start code identifying oper- 

45 ations are detailed with reference to Figs. 7, 9 and 
10. Fig. 9 shows the start code identifier 24 of Fig. 
7 in further detail. Referring to Fig. 9, the start code 
identifier 24 has an expected start code selector 27 
and a start code matching identifier 29. 

so Fig. 10 is a table of layer based expected start 

codes. According to this embodiment, a start code 
detection is accomplished by making an effective 
use of the characteristic layered structure of an 
MPEG-1 video bit stream. A start code to be de- 

55 tected can be predicted based on the latest layer 
information which represents the layer of the pre- 
viously detected start code. The table of layer 
based expected start codes in Fig. 10 is based on 
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the bit stream organization of MPEG-1 video data. 

With reference to Fig. 9, the expected start 
code selector 27 stores the table of layer based 
expected start codes in Fig. 10. The expected start 
code selector 27 selects a group of expected start 
codes based on the latest layer information 18 and 
the table in Rg. 10. The group of layer based 
expected start codes are output as expected start 
codes 28 to the start code matching identifier 29. 
The start code matching identifier 29 compares the 
start code candidate 23 with each of the expected 
start codes 28 to identify the start code candidate 
23. When the start code candidate 23 does not 
match any of the expected start codes 28, but 
does match one of the other start codes in Rg. 4, 
the start code candidate 23 is determined to be an 
error code. Thus, an advantageous feature of this 
embodiment is that a detected start code is iden- 
tified effectively with limited choices of expected 
start codes on a layer basis. 

For example, when the .latest layer information 
18 indicates that the latest layer was a sequence, 
the expected start codes 28 according to the table 
in Fig. 10 are the GOP_start__code, the exten- 
sion data_start__code and the 

user_data_start__code. When the start code can- 
didate 23 matches one of the expected start codes 

28 in this case, the start code matching identifier 

29 identifies the start code candidate 23 as an 
appropriate start code to be detected. When the 
start code candidate 23 matches none of the ex- 
pected start codes 28 and denotes, for example, 
one of the picture_start_code, the 

slice start__codes or the sequence start code, 

the start code matching identifier 29 identifies the 
start code candidate 23 as an error code. 

When the start code candidate 23 is identified 
as an appropriate start code to be detected, the 
start code matching identifier 29 issues the layer 
information 19 and the start code information 20. - 
With the layer information 19, the latest layer in- 
formation in the layer memory 17 is updated as 
required. With the layer and start code information 
19 and 20, the header information decoder 16 
starts its operations and decodes header data fol- 
lowing the identified start code as described earlier. 

Rg. 11 illustrates a header which has a start 
code in the front followed by a series of header 
data and stuff bits or nondata bits as required. The 
header information decoder 16 decodes a series of 
header data following the start code in a header. 
The header information decoder 16 starts decoding 
header data when a start code is identified, and 
stops decoding at the end of the header data in a 
header or when a nondata bit occurs. At this stage, 
the header information decoder 16 issues the 
header information decoding end signal 21 to the 
start code detector 15. The header information 



decoding end signal 21 informs the start code 
detector 15 of a ready state of the header informa- 
tion decoder 16 for decoding another header or 
another start code to be detected, unless the head- 

s er was a slice header. If the header was a slice 
header, decoding in the header information de- 
coder 16 extends continuously to other layers, i.e., 
macroblock and block layers. In such a case, the 
header information decoder 16 suspends decoding 

w at the end of block-data in a block layer until 
another start code is detected in the start code 
detector 15. 

When a substantial error code is detected, the 
start code detector 15 assumes that the operation 
15 is desynchronized and tries to resynchronize itself 
to the incoming data bits in order to recover its 
normal operation. The resynchronization process 
includes error masking in the decoder. A series of 
resynchronizing operations involving error masking 
20 in the decoder, are now detailed. 

The start code detector 15 tries to synchronize 
itself to the incoming bits on a layer basis with 
MPEG-1 video data using a start code as a syn- 
chronization signal for resynchronization. A start 
25 code can serve to help synchronize the start code 
detector 15 for the bit synchronization operation. A 
start code has conventionally been used as a start- 
er signal of a data effective signal for decoding, 
which can prove that data following a start code are 
30 effective. Consequently, data in a layer where a 
substantial error code has been detected are con- 
sidered ineffective. The start code detector 15 dis- 
cards data after the substantial error detection until 
it detects an optimal start code as a start delimiter 
35 of a layer and recovers synchronization. A start 
code used as the synchronization signal should be 
a start delimiter of the same layer as that in which 
a substantial error was detected. Next most prefer- 
ably, the start code selected for the signal should 
40 be a start delimiter of the closest layer type which 
is higher than the layer with the error detection 
according to the hierarchy of a layered bit stream 
of MPEG-1 video data. In other words, it is desir- 
able to recover synchronization in a bit stream as 
45 early as possible in order to shorten the period of 
time that the start code detector is desynchronized 
in order to minimize the possible damage to the 
video data. A start code of a sublayer or a lower 
level layer than that in which the error was de- 
so tected can not be considered a synchronization 
signal. Data in a sublayer or a lower layer are likely 
to be affected and damaged by the error in the 
higher level layer. In this respect, if, for example, a 
slice layer has an error detection with the start 
55 code detector 15 desynchronized, it is ideal to 
reset the synchronization of the detector with the 
slice start__code in the next slice layer. 
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Fig. 12 illustrates the above discussion in more 
detail. Fig. 12 shows the different layers in which 
errors may be detected and the corresponding 
possible choices of start codes as a synchroniza- 
tion signal in a preference or recommended order. 
As illustrated, when an error detection occurs in a 
slice layer, for example, there are four choices of 
resynchronization start codes, namely, 

slice start code, picture start code, 

group start code, and sequence start code in 

preference order. The start code detector can re- 
synchronize itself to the incoming data bits when 
any of the four start codes is detected in order to 
recover its normal decoding operation. 

In the case of a picture layer, for example, a 
normal decoding operation can be recovered when 

any of the picture start code, the 

group start code and the sequence start code 

is detected in order of preference. 

Thus, the start code detector 15 resynch- 
ronizes itself using a start code as a synchroniza- 
tion signal, the specific code used for resynch- 
ronization is selected based on the layer of the 
detected error, as shown in Fig. 12. 

While resynchonizing operations are occurring, 
error masking is implemented in the display con- 
troller 11. Error masking is maintained until a start 
code as a synchronization signal is detected. The 
display controller 11 tries to smooth an error 
damaged area in a frame on the display by using a 
pseudo-image with the following error masking 
techniques discussed below. The display controller 
1 1 may mask error with a patching technique using 
a pseudo-image by borrowing the image neighbor- 
ing an error damaged image in the same image 
frame when those images are considered similar to 
each other. The display controller 11 may mask 
error with a replacement technique using a pseudo- 
image made from previously processed decoded 
image data stored in the memory 12 for reference. 
When images in an error damaged area are con- 
sidered the same or similar to the area of the same 
image address in a previous frame of the decoded 
image data stored in the memory 12, the damaged 
area images can be replaced with the image in- 
formation of the corresponding area in a previous 
frame. 

Error masking lasts from the detection of an 
error start code pattern with the start code detector 
until recovery of synchronism in the start code 
detector. The range or area of error masking in a 
bit stream or video data varies depending on the 
layer in which the error was detected, as Fig. 12 
illustrates. Referring to the figure, when an error 
start code pattern is detected in a sequence layer, 
error masking will last until detection of the se- 
quence__start__code in the next sequence layer. 
An error in the sequence layer results in the long- 



est case of error masking. In this case, the display 
controller 1 1 can implement an image freeze tech- 
nique on the display to cover all error damaged 
area. With an error detection in a picture layer, 

5 error masking will be maintained until the pic- 
ture_ start_code or a start code of a higher level 
layer is detected. In this case, the image freeze 
technique can also be implemented to cover the 
error area. With an error detection in a slice or a 

70 lower level layer, e.g., a macroblock layer or a 
block layer, error masking is maintained until any 
start code listed in Fig. 8 is detected. In this case, 

it is effective to use a slice — start code as a 

synchronization signal, which will result in the shor- 

75 test error masking period. Error masking in this 
case can be implemented with the replacement 
technique stated earlier, in which a pseudo-image 
for a part or all of the slice is constructed using 
previously processed decoded image data stored 

20 in the memory 12 to replace the error damaged 
image. Otherwise, error masking is implemented 
with the patching technique stated earlier, in which 
a pseudo-image is made by borrowing the image 
neighboring an error damaged image. Decoded 

25 image data used for masking an error are sent 
from the memory 12 to the display controller 11 via 
the controller 10. The controller 10 informs the 
display controller 1 1 of an error masking area by a 
control signal. The display controller 11 performs 

30 error masking in the error masking area. 

Thus, the decoder according to this embodi- 
ment can achieve effective error masking of video 
data on the display when an erroneous start code 
pattern is detected. The error masking is imple- 

35 mented by limiting the area of error masking during 
a resynchronizing operation with an optimal start 
code as a synchronization signal selected based on 
a layer with the error detection. 

Fig. 13 is a flowchart of a start code detecting 

40 process in the start code detector 15 according to 
this embodiment. A series of start code detecting 
operations can now be summarized in the following 
operating steps: 

51 A start code detecting operation starts 
45 in the start code detector 15 when the 

power is supplied in the decoder. 

52 A start code detecting operation in the 
start code detector is initialized. The 
layer memory is initialized with a null 

so code, for example, which indicates no 

layer information stored yet in the layer 
memory. The sequence__start__code is 
set as the initial start code which is to 
be detected in a bit stream by the start 

55 code detector 15. 

53 The incoming bit stream is constantly 
watched in the start code detector 15 to 
detect a start code pattern. 

10 
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55 When a start code pattern is detected, 
the operating step proceeds to S6. 

S4 When the sequence^ end_code is de- 
tected, the operating step in the start 
code detector 15 terminates. 

56 A group of layer based expected start 
codes corresponding to a detected start 
code pattern are selected in accordance 
with the latest layer information in the 
layer memory. 

57 The detected start code pattern is com- 
pared with each of the layer based ex- 
pected start codes to identify the type 
of a start code. 

58 When the detected start code pattern 
matches one of the layer based ex- 
pected start codes, data of the latest 
layer information stored in the layer 
memory is updated based on the iden- 
tified start code, and the operating step 
proceeds to S9. 

510 When the detected start code pattern 
matches none of the layer based ex- 
pected start codes, the operating step 
enters into a resynchronization process. 
When the process is completed with a 
synchronization recovered in the start 
code detector, the operating step goes 
back to S3 to detect a start code. 

59 The controller 10 is informed of the 
latest layer information which was up- 
dated in S8, which terminates a series 
of start code detecting operations. Then 
the start code detector 15 starts to 
watch again the incoming data bits to 
detect a start code. The operating step 
goes back to S3. Fig. 14 is a flowchart 
illustrating the 

resynchronization process in S10 of Fig. 
13 in more detail. A series of resynch- 
ronizing operations are now summa- 
rized in the following operating steps: 

511 The resynchronizing process commen- 
ces when the detected start code pat- 
tern matches none of the layer based 
expected start codes in S10 of Fig. 13. 

512 Decoding operations in the header in- 
formation decoder 16 and the block- 
data decoder 7 are suspended. 

513 Error masking is implemented in the 
display controller. 

514 A start code is selected as a synchro- 
nization signal based on the layer cor- 
responding to the detected error and 
set for resynchronization in the start 
code detector. 

515 The incoming data bit stream is 
watched in the start code detector in 



order to detect a start code correspond- 
ing to the resynchronization signal. 

517 When a start code corresponding to the 
signal is detected in S16 or the start 

5 code detector can manage to resynch- 

ronize itself, the error masking termi- 
nates. 

518 Decoding operations in the header in- 
formation decoder 16 and the block- 

ro data decoder 7 resume. This terminates 

the whole process of the resynchroniz- 
ing operation. 

Embodiment 2. 

75 

With further reference to the start code detect- 
ing operation discussed in the previous embodi- 
ment, a decoder of the invention can be designed 
to avoid all error-related . suspension of decoding 

20 operations when the detected error is minor or a bit 
error. According to this embodiment, when a de- 
tected start code pattern is identified as none of 
the layer based expected start codes in the start 
code identifier, the decoder replaces the erroneous 

25 detected start code pattern with the most appro- 
priate start code of all the layer based expected 
start codes in order not to suspend decoding oper- 
ations in the decoder. Decoding will be maintained 
based on the replacement start code. 

30 Fig. 15 is a block diagram of a start code 

detector 15a according to this embodiment. The 
embodiment of Fig. 15 is similar to the embodi- 
ment of Fig. 7, but with the addition of a start code 
replacement unit 31 and the replacement of the 

35 start code identifier 24 in Fig. 7 with a start code 
identifier 24a. Fig. 16 is a block diagram of the 
start code replacement unit 31 of Fig. 15. Referring 
to Fig. 16, the start code replacement unit 31 has 
an expected start code selector 27a, a similarity 

40 calculator 32 and a similarity based replacement 
identifier 34. 

A start code replacement operation in the start 
code replacement unit 31 is now discussed with 
reference to Figs. 15 and 16. When a detected 

45 start code is identified as none of the layer based 
expected start codes, the start code identifier 24a 
issues a replacement start signal 30 to the start 
code replacement unit 31 . The expected start code 
selector 27a has the same function as that of the 

so expected start code selector 27 in Fig. 9. The 
expected start code selector 27a selects a group of 
layer based expected start codes based on the 
latest layer information 18 and the table of layer 
based expected start codes in Fig. 10 in the same 

55 manner as that stated in the previous embodiment. 
The expected start code selector outputs the se- 
lected group of expected start codes as expected 
start codes 28 to the similarity calculator 32. The 

11 
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similarity calculator 32 calculates similarity between 
the bit pattern of the start code candidate 23 from 
the unique pattern detector 22 and a bit pattern of 
each of the expected start codes 28 from the 
expected start codes selector 27a. The similarity 5 
calculator 32 outputs a series of similarity values 
33 for each expected start code to the similarity 
based replacement identifier 34. The similarity 
based replacement identifier 34 identifies the start 
code of all of the expected start codes 28 which is to 
most similar to start code candidate 23 as a re- 
placement start code based on similarity values 33 
issued from the similarity calculator 32. Decoding 
will be maintained based on the replacement start 
code. 75 

Fig. 17 shows the similarity calculator 32 in the 
start code replacement unit 31 in Fig. 16. The 
similarity calculator 32 evaluates similarity by cal- 
culating the Hamming distance or a code distance 
between two bit patterns of start codes. The Ham- 20 
ming distance is the number of bit positions that 
differ between two code words of the same length. 
For example, in "010010" and "110100", the Ham- 
ming distance is three. Similarity between two spe- 
cific code words is assumed to be a function of the 25 
Hamming distance, i.e., two start codes are consid- 
ered more similar the lower the Hamming distance 
between them. Referring to Fig. 17, each bit of the 
start code candidate 23 is EXCLUSIVE-ORed sepa- 
rately with each corresponding bit of each of the 30 
layer based expected start codes 28 in an EXCLU- 
SIVE-OR operator 35. Each EXCLUSIVE-ORed re- 
sult is sent to a non-zero bit counter 36 which 
counts the number of bit positions where the EX- 
CLUSIVE-ORed result is 1. 35 

The Hamming distance is calculated using only 
the last eight bits of the 32 bit start code candidate 
23 and expected start codes 28. As an example, let 

us assume that the sequence start_code 

"000001 B3 in hexadecimal" is detected when the 40 
latest layer information indicates a picture layer. 
Layer based expected start codes corresponding to 
that condition are a slice__start_code "00000101 

in hexadecimal", an extension data__start__code 

"000001 B5 in hexadecimal" and a user_data 45 
start_code "000001 B2 in hexadecimal" according 
to the table in Fig. 10. Then, the Hamming dis- 
tances between the sequence start_code and the 

expected start codes are respectively, 4 for the 
slice_start__code "00000101", 2 for the exten- 50 

s ion data_start_code , and 1 for the 

user_data_ start_code. Consequently, of the ex- 
pected start codes 28, the user__data_start code 

has the smallest Hamming distance and is consid- 
ered the most similar start code to the se- 55 
quence_start_code. 

In this case, the similarity based replacement 
identifier 34 decides that the 



user data__start_code is the most appropriate re- 
placement start code for the start code candidate 

23, i.e., the sequence start code. The similarity 

based replacement identifier 34 then issues the 
layer information 19 and the start code information 
20 based on the replacement start code, the 
user_data__start_code in this case. Data of the 
latest layer information 18 stored in the layer mem- 
ory 17 is then updated as required according to the 
layer information 19. The header information de- 
coder 16 starts with the layer information 19 and 
the start code information 20. 

Fig. 18 is a flowchart of a start code detecting 
process in the start code detector 15a according to 
this embodiment. The flowchart in Fig. 18 adds a 
start code replacement step S20 and omits the 
resynchronization step S10 of the flowchart in Fig. 
13. In other words, the operating steps S1 through 
S9 in Fig. 18 corresponds to those in Fig. 13. This 
section, therefore, focuses only on a start code 
replacement operation including the start code re- 
placement step 20 by avoiding the repetition of the 
same reference to the other steps as those in Fig 
13. 

Referring to Fig. 18, when a detected start 
code pattern or the start code candidate 23 match- 
es none of the layer based expected start codes in 
S7, the start code candidate 23 is replaced by the 
most appropriate start code for replacement of all 
the layer based expected start codes in S20. A 
replaced start code for the start code candidate is 
considered a start code in S8 and S9 hereinafter 
for further decoding operations in the decoder. 

Fig. 19 is a flowchart illustrating a start code 
replacement process in S20 in Fig. 18 in more 
detail according to this embodiment. A series of 
replacement operations are summarized in the fol- 
lowing operating steps: 

522 The Hamming distance is calculated be- 
tween a detected start code pattern, i.e., 
the start code candidate and each layer 
based expected start code inside the 
start code detector. 

523 The expected start code with the small- 
est Hamming distance from the start 
code candidate is selected as an appro- 
priate replacement start code. 

524 The start code candidate is replaced by 
the replacement start code selected in 
S23. 

Embodiment 3. 

With further reference to the previous embodi- 
ment, a decoder of the present invention can im- 
plement an improved method of similarity evalu- 
ation in the similarity calculator 32. This embodi- 
ment is further based on a well-known fact that two 
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bit patterns may have the same Hamming distance 
to a third pattern, yet one of the two patterns may 
be much more similar than the other to 
pattern. For examp.e. 00000010 -^JJ** 
00000001 than 10000000. even though 00000010 
and 10000000 have the same Hamming distance to 
00000001. Similarity based evaluation n this em- 
bodiment further implements a ^"JJJJJ 
using such a consideration. An EXCLUSIVE-ORed 
value in each bit position of a bit pattern be*veen 
two codes is weighted for similarity calculation by 
the following formula: 

w(8)"d(8) + w(7)'d(7) + - + w(1)'d(1) 

Referring to the formula. -w(8)-d(8)" for example 
denotes that a weight coefficient .n the eighth brt 
position of the bit pattern. -w(8)", 
an EXCLUSIVE-ORed value in the eighth bit pos 
tion in the bit pattern. "d<8)". » his scheme ' w<8) - 
>w(7)> >w(1). 

Embodiment 4. 



With further reference to F.g. 16. a decoder of 
the present invention can have a start code re- 
placement unit which prioritizes layer based ex- 
pected start codes. Fig. 20 is a block diagram of a 
start code replacement unit 31a. The embodiment 
of Fig. 20 is similar to the embodiment of F.g. 16 
except that the similarity calculator 32 and the 
Sity based replacement identifier 34 are re- 
placed by a priority assigning numerator 37 anda 
parity based replacement identifier 39. respec- 

tiV6l ^e start code replacement unit 31a according 
to this embodiment selects a replacemen start 
code based on a priority based evaluation of layer 
based expected start codes. Layer based expected 
start codes in Fig. 10 are prioritized in order of 
their expectation of occurrence in the bit streara 
eSi of the layer based expected start codes is 
aligned a numerical value based on its probability 

of TO ™™'J ce !hows a b|ock diagra m of the priority 
assigning numerator 37 where the layer based ex- 
pect* Lrt codes are prioritized with « i pnonty 
Eased numerical value based on the e*Pf**'°" 
occurrence. An evaluation memory table is pro- 
vided in the priority assigning numerator 37 Pig. 
22 is an example of the evaluation memory table 
40 

' According to the evaluation memory table in 
Pig 22 for replacement evaluation, the layer based 
expected start codes are assigned numerical val- 
ues based on the probability or expectaton erf 
occurrence. Each layer based group of expected 
start codes is assigned a fixed value for evaluation. 



10 in this example. Thus, the sum of the expecta- 
tion values of all expected start codes n each 
group is 10. The probability of occurrence for each 
Tayer based expected start code is calculated by 
s dividing a value of the expectation of occurrence 
bv the fixed value of 10. 

For example, when the latest layer information 
is a sequence layer, the corresponding layer based 
expected tart codes are the group start code 
J0 -000001 B8 in hexadecimal". the exten- 
sion data start_code "000001B5 m hex- 
adecimal" ~ and the user_data_start_code 
"000001 B2 in hexadecimal". Referring to the evalu- 
ation memory table in Fig. 22. the exten- 
,s sion data start code and ™ 

uir data^starTcode are given a smaller value 
for the" expectation of occurrence. 1 out of 10 eacn. 
because these start codes are usually optional in a 
bit stream of MPEG-1 video data. On the other 
20 hand, the group_start__code is given a larger val- 
ue for the expectation of occurrence. 8 out of 10. 
because the group_start_code is usually a must 
in a bit stream of MPEG-1 video data. 

Referring further to Fig. 22. when the atest 
25 layer information is a GOP layer or a picture layer 
the extension_data_start_code and the 
user_data_start_code are each assigned a prob- 
ability of occurrence value 2. 

The extension_data_start_code or the 
30 user data start_code is usually optional as stat- 
ed earlier "depending greatly on the organizers 
intention. A value for the expectation of occurrence 
is assigned depending on the bit stream type, e.g.. 
MPEG-1 With a bit stream which contains no ex- 
35 tension data or user data, a probability of occur- 
rence value of 10 is assigned to the 
group start code when the latest layer is a se- 
quence: as ihown in the alternative memory tab e 
fn Fio 23. If the bit stream contains extension data 
«, but no user data, a value of 8 out of 10 may be 
assigned to the group_start_code tor the expec- 
tation of occurrence and a value of 2 out of 10 to 
the extension_data_start_code as shown in the 
evaluation memory table in Fig. 24. 
« With further reference to the evaluation mem- 
ory tables in F,gs. 21 through 24. values for the 
expectation of occurrence can be dynamically al- 
tered according to the incoming bit stream type- 
Values for the expectation of occurrence alternately 
so can be dynamically updated by analyzing the pre- 
viously processed data when the type of a brt 
stream is not known in advance. Furthermore, the 
priority assigning numerator 37 can be provided 
with different types of evaluation memory table 
55 such as those in Figs. 22 through 24 for different 
woes of bit streams. Then the priority assigning 
numerator 37 assigns an optimal evaluation to the 
incoming data by selecting the most appropnate 
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one of the evaluation memory table from among 
many choices. Otherwise, the priority assigning nu- 
merator 37 can assign an optimal evaluation by 
switching the evaluation memory table automati- 
cally or manually from one choice to another 
among many choices depending on data. 

After assigning priority to each of the layer 
based expected start codes based on the value in 
the evaluation memory table, the priority assigning 
numerator 37 sends the prioritized expected start 
codes to a priority based replacement identifier 39. 
The priority based replacement identifier 39 selects 
an expected start code with the highest expectation 
value of occurrence from among others as a re- 
placement for the start code candidate. A decoding 
operation will be proceeded hereinafter based on 
the replacement start code in the corresponding 
layer. 

Embodiment 5. 

With further reference to the evaluation mem- 
ory table 40 in the priority assigning numerator 37 
in Fig. 21, the probability of occurrence can be 
assigned a priority number in descending or as- 
cending order from the highest or lowest probabil- 
ity of occurrence rather than a value of the prob- 
ability of occurrence. Fig. 25 shows another exam- 
ple of the evaluation memory table 40. According 
to this embodiment, each of the layer based ex- 
pected start codes is given a priority number in 
descending order from the highest expectation of 
occurrence. According to the table in Fig. 25, the 
group__start_code is the first in the priority order, 

the extension data_start_code is the second in 

the priority order and the user_data_start_code 
is the third in the priority order when the latest 
layer is a sequence. 

Embodiment 6. 

With further reference to the start code re- 
placement unit 31 , a decoder of the present inven- 
tion can be provided with a start code replacement 
unit which employs the similarity calculator 32 of 
the second embodiment and the priority assigning 
numerator 37 of the fourth embodiment. Fig. 26 
shows a block diagram of a start code replacement 
unit 31b according to this embodiment. Referring to 
the figure, the start code replacement unit 31b has 
the similarity calculator 32 which is the same unit 
as that in Fig. 16, the priority assigning numerator 
37, which is the same unit as that in Fig. 20, and a 
replacement identifier 41. 

In the start code replacement unit 31b, the 
similarity calculator 32 calculates a code distance 
between the start code candidate 23 detected in 
the unique pattern detector 22 and each of the 



expected start codes 28. Meanwhile, the priority 
assigning numerator 37 prioritizes the expected 
start codes 28 with numerical values for the ex- 
pectation or probability of occurrence. The replace- 

5 ment identifier 41 identifies the most appropriate 
start code to be detected among the expected start 
codes 28 based on the results of the similarity 
value 33 from the similarity calculator 32 and a 
prioritized value 38 from the priority assigning nu- 

io merator 37 in accordance with a predetermined 
criterion. 

The following is an exemplary evaluation for- 
mula for replacement: W= D[Pi(L)J-E[Pi(L)] 
Referring to the formula, Pi(L) is one of the ex- 

15 pected start codes 28 Pi based on a layer L of the 
latest layer information. D[Pi(L)] is a code distance 
D between the start code candidate 23 and one of 
the layer based expected start codes Pi(L). E[Pi(L)] 
is a value of the expectation of occurrence of one 

20 of the layer based expected start code Pi(L). Ac- 
cording to the formula, the start code with the best 
combination of a low code distance and a high 
expectation of occurrence will be selected as the 
replacement start code in the replacement identifier 

25 41. 

A decoding operation will then be carried out 
based on the replacement start code in the cor- 
responding layer. 

30 Embodiment 7. 

With further reference to the sixth embodiment, 
the evaluation for replacement of the present inven- 
tion can also be based on weighted values of 
35 similarity as set forth in the third embodiment or 
prioritized data with a priority number assigned to 
the probability of occurrence in the fifth embodi- 
ment. 

40 Embodiment 8. 

Replacement evaluation of the present inven- 
tion can be based on another formula. Fig. 27 
shows a block diagram of a replacement identifier 

45 41a which has a weight coefficient A multiplier 42, 
a weight coefficient B multiplier 43 and a replace- 
ment evaluator 44. 

In this embodiment, the similarity value 33 and 
the prioritized value 38 output from the similarity 

so calculator 32 and the priority assigning numerator 
37, respectively, in the sixth embodiment are 
weighted in the replacement identifier 41a. The 
similarity value 33 and the prioritized value 38 are 
weighted by multiplying a certain coefficient re- 

55 spectively in a weight coefficient B multiplier 43 
and a weight coefficient A multiplier 42. A weight 
based value W* is calculated by the following for- 
mula: W = A*D[Pi(L)] + B*E[Pi(L)] 
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This weight based calculation produces a choice of 
evaluation between similarity oriented evaluation 
and priority oriented evaluation. 

An exemplary weight based evaluation method 
is described below. Slice layers tend to occur 5 
consecutively in an MPEG-1 video data bit stream 
due to its layered data structure. Therefore, it is 
relatively likely to detect a plurality of 
slice_start_codes consecutively. In other words, 
the slice__start__codes have the highest probability 10 
of occurrence value of all the start codes. For this 
reason, it is desirable to give more weight to the 
probability of occurrence, E t than the similarity of 
codes, D, in order to select a slice_start_code as 
a replacement start code. In such a case, the 75 
above formula would be implemented with B>A. 

A decoding operation would then be carried out 
based on the replacement in the corresponding 
layer. 

20 

Embodiment 9. 

With further reference to the start code re- 
placement unit in the fourth and sixth embodi- 
ments, a priority assigning numerator of the 25 
present invention can be controlled so as to update 
the probability of occurrence table for layer based 
expected start codes in a probability based evalu- 
ation. Fig. 28 shows a block diagram of a priority 
assigning numerator 37a according to this embodi- 30 
ment. The priority assigning numerator 37a has a 
probability updating unit 45 and an evaluation 
memory table 40a. 

The probability updating unit 45 updates values 
of the probability of occurrence to be assigned to a 35 
group of layer based expected start codes in the 
priority assigning numerator 37a based on the lat- 
est layer information 18 and the start code informa- 
tion 20 in advance. Updated values of the probabil- 
ity of occurrence for the group of layer based aq 
expected start codes in the probability updating 
unit 45 are input in the evaluation memory table 
40a to update the previously assigned values. Each 
of the group of layer based expected start codes is 
assigned the updated value of probability of occur- 45 
rence based on the updated evaluation memory 
table. 

The updating method of the probability of oc- 
currence according to this embodiment works as 
described below. A slice is a part of a picture. The so 
last eight bits of a bit pattern of a slice start code 
indicate the location on the video screen. In this 
respect, neighboring slices tend to appear con- 
secutively as stated earlier. It is highly likely there- 
fore that a slice_start_code is followed by another 55 
slice__start__code. For this reason, it is desirable to 
assign a higher probability of occurrence to a 
slice start__code in a group of layer based ex- 



pected start codes when the previously detected 
start code is a slice__ start_code. Thus, according 
to this embodiment, this method can update prob- 
ability of occurrence values optimally based on 
detected start code patterns, which can accomplish 
a highly reliable start code replacement operation 
in the decoder. 

Embodiment 10. 

With further reference to the start code re- 
placement unit 31b in Fig. 26. a start code replace- 
ment operation with a sophisticated method of de- 
fining the most appropriate replacement start code 
is provided by locally decoding data in accordance 
with two or more possible replacement start codes 
before identifying a replacement start code in order 
to improve replacement reliability. Fig. 29 shows a 
start code replacement unit 31c according to this 
embodiment. The start code replacement unit 31c 
has a replacement determiner 46 and a decoding 
time memory 47. The decoding time memory 47 
stores layer based decoding time values for an 
error check. 

The start code replacement operations dis- 
cussed hereinbefore seem to bear common 
drawbacks in the following respects: A start code 
replacement unit replaces an erroneous start code 
with the most appropriate start code of all the layer 
based expected start codes. This operation, how- 
ever, still does not guarantee that the replacement 
start code is correct. Furthermore, a replacement 
operation may result in two or more expected start 
codes being assigned the same replacement value. 
According to this embodiment, the start code re- 
placement unit is designed to improve reliability of 
a start code replacement operation in view of those 
problems. In this embodiment, the corresponding 
received data is locally decoded in the start code 
replacement unit based on two or more start codes 
of a group of layer based expected start codes 
which are found to be equally appropriate can- 
didates. A replacement start code is identified 
based on the decoded result of the replacement 
candidates for a predetermined time period. De- 
coding will be maintained based on the replace- 
ment start code. 

Referring to Fig. 29, the replacement identifier 
41b identifies two or more replacement candidates 
and outputs them to the replacement determiner 
46. The replacement determiner 46, a local de- 
coder, decodes the replacement candidates for a 
predetermined period of time. 

The replacement determiner 46 can be pro- 
vided with the same functions as those of the 
header information decoder 16 and the data-block 
decoder 7. Otherwise, the replacement determiner 
46 can make the header information decoder 16 
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and the data-block decoder 7 locally decode the 
replacement candidates. Data following the re- 
placement candidates are locally decoded for a 
required period of time. The time period can be a 
function of the layer of a replacement candidate or 
the latest layer information corresponding to a re- 
placement candidate. 

Fig. 30 shows a table of decoding time stored 
in the decoding time memory 47. The table of 
decoding time lists layer based prescribed local 
decoding time enough for detecting error. When a 
large amount of error is detected in a replacement 
candidate in a given period of decoding time as set 
forth in the table, it is likely that the replacement 
candidate is not the proper replacement start code. 
In other words, the replacement determiner 46 
identifies as the proper replacement start code the 
start code which results in the least error detected 
in the local decoding. 

Thus, the decoder according to this embodi- 
ment can achieve effective and reliable decoding 
with an utmost appropriate replacement start code 
selected from among two or more replacement 
candidates. 

Embodiment 11. 

With further reference to the tenth embodiment 
of the present invention, the replacement identifier 
41b in the start code replacement unit 31c in Fig. 
29 can be replaced with the similarity based re- 
placement identifier 34 in the start code replace- 
ment unit 31 in Fig. 16 discussed in the second 
embodiment. 

Embodiment 12. 

With still further reference to the tenth embodi- 
ment of the present invention, the replacement 
identifier 41b in the start code replacement unit 
31c in Fig. 29 can be replaced with the priority 
based replacement identifier 39 in the start code 
replacement unit 31a in Fig. 20 discussed in the 
fourth embodiment. 

Embodiment 13. 

With further reference to the inventive arts of 
start code replacement discussed in the second 
through ninth embodiments, a decoder of the 
present invention can include a controller for con- 
trolling implementation of a start code replacement. 

According to this embodiment, a start code 
replacement operation is commenced only under 
the following conditions: 

1. Tire start code candidate is detected after 
data corresponding to the previously detected 
start code is decoded in the header information 



decoder or the block-data decoder; and, 
2. The number of minor errors (or bit errors), 
which should give no influence to continuing 
decoding, detected in the inventive decoder be- 
5 fore the error detection of a start code pattern is 
less than a given number. 
These conditions assumes that the decoder 
had been conducting a normal decoding operation 
before a start code pattern is detected by error. 
io This further assumes that the start code candidate 
is one of the layer based expected start codes. 
Consequently, the start code candidate detected in 
a situation lacking these conditions is highly likely 
to be no start code. In other words, it is an error 
75 code to be discarded and if replacement is imple- 
mented based on the error code, decoding will be 
damaged. 

Fig. 31 shows a block diagram of a start code 
detector 15b according to this embodiment. Refer- 

20 ring to the figure, the start code detector 15b 
includes a replacement controller 48 and switches 
60 for a replacement control. The replacement con- 
troller 48 controls the implementation of replace- 
ment based on error information 49 with a data 

25 decoding end signal 8 or the header decoding end 
signal 21. 

The header decoding end signal 21 is output 
from the header information decoder 16 and in- 
dicates that the decoding of data corresponding to 

30 the previously detected start code at, for example, 
C2, C3, C4 or C5 in Fig. 3 has ended. The data 
decoding end signal 8 is output from the block-data 
decoder 7 and indicates that the decoding of data 
corresponding to the previously detected start code 

35 at, for example, C6, C7, C8, C11, C12 or C13 in 
Fig. 3 has ended. The error information 49 is 
output from the controller 10 informing of the num- 
ber of minor or bit errors detected while decoding 
in the block-data decoder 7 or the header informa- 

40 tion decoder 16 is determined by the controller 10. 

When the header information decoder 16 or the 
block-data decoder 7 is desynchronized, however, 
the header decoding end signal 21 or the data 
decoding end signal 8 is considered damaged and 

45 cannot be trusted to detect a start code. The error 
information 49 indicates whether those decoders 
are in synchronism. The number of minor errors 
counted in the controller 10 of the error information 
49 indicates to some extent the decoding condition 

so of those decoders. The replacement controller 48, 
therefore, refers to the error information 49 when 
receiving the block-data decoding end signal 8 or 
the header decoding end signal 21 from the block- 
data decoder 7 or the header information decoder 

55 16. When the number on the error information 49 is 
less than a given number, the replacement control- 
ler 48 allows the start code replacement unit 31 d to 
implement a start code replacement. Otherwise, 
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the start code candidate is discarded without a 
replacement. 

Fig. 32 is a flowchart of a replacement control 
operation in the replacement controller 48. A re- 
placement control method in the start code detec- s 
tor 15b is now described by the following operating 
steps: 

531 A replacement control operation starts 
when the start code detector 15b starts. 

532 The replacement controller 48 waits un- io 
til the header decoding end signal 21 is 
input. 

533 Otherwise, the replacement controller 
48 waits until the data decoding end 
signal 8 is input. 75 

534 When the decoding signal is input in 
S32 or S33, the replacement controller 
48 refers to the error information 49 
input from the controller 10. 

535 The replacement controller 48 com- 20. 
pares the number of minor error on the 
error information 49 with a preset num- 
ber for comparison. 

536 When the number on the error informa- 
tion 49 is less than the preset number 25 
in S35 t the replacement controller 48 
sends a control signal to the switches 

60 to allow the start code replacement 
unit 31 d to implement a replacement. 
Consequently, the replacement start 30 
signal 30 and the start code candidate 
23 are sent to the start code replace- 
ment unit 31 d from the start code iden- 
tifier 24b via the switches 60. 

537 When the number on the error informa- 35 
tion 49 exceeds the present number in 
S35, the replacement controller 48 is- 
sues a control signal to the switches 60 

and an error signal to the controller 10. 
Consequently, the controller 10 recog- 40 
nizes that the start code candidate is an 
error code detected by error and starts 
a resynchronizing operation in the same 
manner stated earlier. 
The replacement control method implemented 45 
in the start code detector 15b enables the inventive 
decoder to accomplish an effective decoding by 
reducing the possibility of an erroneous start code 
replacement. This can contribute to highly reliable 
decoding with replacement. 50 

Embodiment 14. 

With further reference to the previous embodi- 
ments dealing with a bit stream of MPEG-1 video 55 
data, a decoder of the present invention can de- 
code a bit stream of MPEG-2 video data with the 
same method implemented with MPEG-1 video 



data stated earlier in the previous embodiments. 
MPEG-2 video data is very similar to MPEG-1 
video data in its bit stream syntax because the 
types of start codes and the layered structure of a 
bit stream adopted in MPEG-2 video data are al- 
most the same as those of MPEG-1. In this re- 
spect, the inventive methods of a start code iden- 
tification and replacement based on the layered bit 
stream organization with MPEG-1 video data can 
be applied to MPEG-2 video data. (The MPEG-2 
video data will be standardized by the prescriptions 
of ISO/IEC 13818-2 and LTU-T H.262.) 

Fig. 33 shows a table of layer based expected 
start codes of MPEG-2 video data which corre- 
sponds to that in Fig: 10 of MPEG-1 video data. As 
a characteristic feature of MPEG-2 video data, the 
sequence__start_code and the pic- 
ture_start__code are always followed by the exten- 
sion data start code. In other layers, extension 

data are optional. The exten- 
sion data_start_code, therefore, should have a 

top priority in the expectation of occurrence in a 
sequence layer and a picture layer in MPEG-2 
video data. In a replacement evaluation in MPEG-2 
video data, this characteristic organization of start 
code in the bit stream should therefore be consid- 
ered. 

The table of layer based expected start codes 
in Fig. 33 is applicable to both MPEG-1 and 
MPEG-2 video data. MPEG-2 is an extended speci- 
fication of MPEG-1 and consequently a decoder for 
MPEG-2 video data should be designed to decode 
both MPEG-1 and MPEG-2 video data. As briefly 
mentioned earlier, the characteristic difference be- 
tween MPEG-1 and MPEG-2 video data concerns 

extension data. The extension data start code 

always follows the sequence start code or the 

picture_start__code in a bit stream of MPEG-2 
video data, but not in a bit stream of MPEG-1 video 
data. In this respect, the type of video data, MPEG- 
1 or MPEG-2, can be distinguished by bit stream 
organization with or without the exten- 

sion__data__start code following the se- 

quence_start code or the picture start code. 

The decoder for dealing with the both video data 
can identifies the type of video data by the exis- 
tence or absence of the exten- 
sion_data__start_code after the se- 
quence__start__code in a bit stream. When the 

sequence__start__code or the picture start__code 

is not followed by the extension_data start_code 

in a video bit stream, then the decoder should 
identify the video data as MPEG-1. This inventive 
decoder uses an algorithm common to both 
MPEG-1 and MPEG-2 video data for decoding data 
in a bit stream until the type of video data is 
identified. Once the type of video data is identified, 
the decoder switches to another algorithm optimal 
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to the identified video data for further decoding of a 
bit stream. 

Thus, the decoder according to this embodi- 
ment is applicable to a bit stream intermingled with 
both of MPEG-1 and MPEG-2 data, as well as an 
exclusive bit stream of MPEG-1 video data or 
MPEG-2 video data. 

Embodiment 15. 

With further reference to the previous embodi- 
ments dealing with a start code in MPEG-1 and/or 
MPEG-2 video data as a synchronization signal, a 
decoder of the present invention can detect a sys- 
tem start code as well as a start code in MPEG-1 
and/or MPEG-2 system data as a synchronization 
signal. The MPEG-1 and MPEG-2 system data 
have a multiplexed data structure including dif- 
ferent media information of audio, video, data. etc. 
The inventive method of this embodiment provides 
a decoder to synchronize decoding between 
MPEG-1 and/or MPEG-2 video data and MPEG-1 
and/or MPEG-2 audio data for effective start code 
identification and replacement. 

Fig 34 shows a bit stream of MPEG-1 system 
data (ISO/IEC 11172-1) and its detailed diagrams. 
Referring to the figure, a pack layer is the upper 
level in a hierarchical structure of the data. A pack 
layer is followed by a system layer with sublayers 
of a packet layer in the bit stream. Fig. 35 shows a 
table of layer based expected start codes of 
MPEG-1 system data. The art of start code iden- 
tification or replacement discussed in the previous 
embodiments is applicable to MPEG-1 system data 
in view of the above stated characteristic organiza- 
tion of a bit stream. 

Embodiment 16. 

With further reference to the previous embodi- 
ments dealing with a layered bit stream organized 
in a regular order from an upper level layer to a 
lower level layer, a decoder of the present inven- 
tion can deal with a layered bit stream organized in 
various ways if organized in a regular order. Fig. 36 
shows different types of layered structure in a bit 

stream. .„ _ x 

Referring to Fig. 36. a diagram (a) illustrates a 
layered structure of a data sequence in a bit 
stream where an upper level layer is followed by 
the lower layers and ends the data sequence w.th 
the upper level layer again. A diagram (b) illus- 
trates another layered structure of a data sequence 
in a bit stream where an upper level layer is 
followed by the lower layers, one of which is fol- 
lowed by its lower level layers which ends the data 
sequence. A diagram (c) illustrates a intermingled 
layered structure of a data sequence in a bit 



stream which combines the two different types of 
layered structure of (a) and (b). 

According to this embodiment, the art of start 
code identification or replacement discussed in the 
5 previous embodiments can be applied to a data 
system based on any type of layered structure 
shown in Fig. 36. 



Embodiment 17. 



TO 



With further reference to the inventive arts im- 
plemented in a decoder for decoding data dis- 
cussed in the previous embodiments, the arts can 
also be applied to a data receiver where data are 
is received and used with no process of decoding. 

A data receiver with the inventive arts can 
predict the type of incoming data based on the 
type of the processing data by using the nature of 
the inventive data stream organization by which 
2 o data are input with a certain regularity. This can 
reduce a misuse of ah error start code. 

In a data receiving method relating to the 
present invention, an expected start code is se- 
lected based on the type of the processing data 
25 and the previously detected start code, and a new- 
ly detected start code is compared with the se- 
lected expected start code. When the detected 
start code does not accord with the expected start 
code, the data receiver resynchronizes itself to the 
so incoming data. This can recover a normal data 
receiving performance in an early stage and re- 
store the receiving error automatically. 

In a data receiving method relating to the in- 
vention, a detected start code pattern is replaced 
35 with an expected start code when they do not 
match, and a data receiving operation is continued 
based on the replacement start code. This can 
prevent the misuse of a detected error start code. 

40 Claims 

1. An apparatus for receiving and decoding a bit 
stream of data blocks which are organized in a 
hierarchical order of layers, each of the data 
45 blocks corresponding to one of the layers and 

including a start code which identifies the layer 
of the data block, the apparatus comprising: 

a layer memory for storing data indicating 
the layer corresponding to the last start code 
so received in the data stream, the layer memory 

having a last layer output, 

a start code detector, coupled to receive 
the bit stream and the last layer output, for 
detecting start codes by comparing data in the 
55 bit stream with a set of expected start codes, 

the set of expected start codes being selected 
responsive to the last layer output, the start 
code detector selecting one of the expected 
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start codes as a detected start code, if one of 
the expected start codes is acceptably similar 
to data in the bit stream, the start code detec- 
tor having a start code detector output which 
identifies the detected start code and its cor- s 
responding layer, 

means responsive to the start code detec- 
tor output for updating the layer memory with 
data indicating the layer corresponding to the 
detected start code, and 10 

a block data decoder, responsive to the 
detected start code output from the start code 
detector, for decoding the data block corre- 
sponding to the detected start code. 

75 

2. An apparatus as set forth in Claim 1 wherein 
the start code detector comprises: 

a unique pattern detector coupled to re- 
ceive the bit stream and detect start code 
prefixes, the unique pattern detector having an 20 
output on which possible start codes corre- 
sponding to" detected start code prefixes are 
placed, and 

a start code identifier, coupled to receive 
the output of the unique pattern detector and 25 
the last layer output front the layer memory, 
for comparing the possible start codes from 
the unique pattern detector with one or more 
expected start codes based on the last layer 
output, the start code identifier having a start 30 
code identifier output in a first state which 
indicates that an error has occurred, if no ex- 
pected start code is acceptably similar to the 
possible start code, and in a second state 
which identifies the detected start code and 35 
the corresponding layer, if an expected start 
code is acceptably similar to the possible start 
code. 

3. An apparatus as set forth in Claim 2 wherein aq 
the block data decoder is responsive to the 
start code identifier output being in the first 
state for suspending block data decoding, and 
wherein the apparatus further comprises a dis- 
play controller, the display cohtrWfer respon- 45 
sive to the start code identifier output being in 

the first state to perform error masking cor- 
responding to the error. 

4. An apparatus as set forth in Claim 3 further so 
comprising means for instructing the display 
controller to cease the error masking and in- 
structing the block data decoder to resume 
block data decoding when the start code iden- 
tifier next detects a start code corresponding 55 
to a layer which is the same as or higher in the 
layer hierarchy. 



5. An apparatus as set forth in Claim 1 wherein 
the start code detector comprises: 

a unique pattern detector coupled to re- 
ceive the bit stream aid detect start code pre- 
fixes, the unique pattern detector having a 
unique pattern detector output on which possi- 
ble start codes corresponding to detected start 
code prefixes are placed, 

a first expected start code selector coup- 
led to receive the last layer output from the 
layer memory, the first expected start code 
selector selecting and generating a first ex- 
pected start code selector output identifying 
one or more expected start codes based on 
the last layer, 

a start code matching identifier, coupled to 
receive the unique pattern detector output and 
the first expected start code selector output, 
for comparing the possible start code from the 
unique pattern detector with the. one or more 
expected start codes based on the last layer 
output, the start code matching identifier gen- 
erating a replacement start signal output if the 
possible start code does not match any of the 
expected start codes, and 

a start code replacement unit, responsive 
to the replacement start signal output, the start 
code replacement unit comprising, 

a second expected start code selector for 
selecting one or more expected start codes 
based on the last layer, and generating an 
output indicating the expected start codes, 

a similarity calculator, coupled to receive 
expected start codes from the second expect- 
ed start code selector and the possible start 
code, for calculating and generating an output 
indicating a Hamming distance of the possible 
start code to each of the expected start codes 
from the second expected start code selector, 
and 

a similarity based replacement identifier, 
coupled to receive the output of the similarity 
calculator, for selecting and generating a start 
code identifier output indicating the one of the 
expected start codes with the smallest Ham- 
ming distance to the possible start code. 

6. An apparatus as set forth in Claim 5 wherein 
the Hamming distances are calculated by de- 
termining the number of bits of each of the 
expected start codes which do not match the 
corresponding bit of the possible start code. 

7. An apparatus as set forth in Claim 5 wherein 
the Hamming distances are calculated for each 
expected start code by determining each bit of 
the expected start code which does not match 
the corresponding bit of the detected start 
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code, weighting each of the bits based on its 
bit position to generate a weighted bit value 
and summing all of the weighted bit values. 

& An apparatus as set forth in Claim 1 wherein 
the start code detector comprises: 

a unique pattern detector coupled to re- 
ceive the bit stream and detect start code 
prefixes, the unique pattern detector having a 
unique pattern detector output on which possi- 
ble start codes corresponding to detected start 
code prefixes are placed, 

a first expected start code selector coup- 
led to receive the last layer output from the 
layer memory, the expected start code selec- 
tor selecting and generating a first expected 
start code selector output identifying one or 
more expected start codes based on the last 
layer output, 

a start code matching identifier, coupled to 
receive the unique pattern detector output and' 
the first expected start code selector output, 
for comparing the possible start code from the 
unique pattern detector with the one or more 
expected start codes based on the last layer 
output, the start code matching identifier gen- 
erating a replacement start signal output if the 
possible start code does not match any of the 
expected start codes, and 

a start code replacement unit, responsive 
to the replacement start signal output, the start 
code replacement unit comprising, 

a second expected start code selector for 
selecting one or more expected start codes 
based on the last layer and generating an 
output indicating the expected start codes, 

a priority assigning numerator, coupled to 
receive expected start codes from the second 
expected start code selector and to reveive the 
last layer output, for calculating and generating 
an output indicating a probability of occurrence 
for each expected start code received from the 
second expected start code selector, and 

a priority based replacement identifier, 
coupled to receive the output of the priority 
assigning numerator, for selecting and generat- 
ing a start code identifier output indicating the 
one of the expected start codes with the high- 
est probability of occurrence. 

9. An apparatus as set forth in Claim 8 wherein 
the priority assigning numerator output indi- 
cates priority of each expected start code by a 
numerical value based on probability of occur- 
rence relative to other expected start codes. 

10. An apparatus as set forth in Claim 8 wherein 
the priority assigning numerator output indi- 



cates priority of each expected start code by 
its order of probability from most likely to least 
likely relative to other expected start codes 
without indicating actual probability of occur- 
s rence. 

11. An apparatus as set forth in Claim 1 wherein 
the start code detector comprises a replace- 
ment determiner for selecting a detected start 

to code from the expected start codes, the re- 

placement determiner locally decoding the 
block data for a predetermined time period in 
accordance with a plurality of the expected 
start codes and detecting a number of decod- 

75 ing errors for the block data for each of the 

plurality of expected start codes and selecting 
as the detected start code a one of the plural- 
ity of expected start codes in which the fewest 
decoding errors were detected. 

20 

12. A method for receiving and decoding a bit 
stream of data blocks which are organized in a 
hierarchical order of layers, each of the data 
blocks corresponding to one of the layers and 

25 including a start code which identifies the layer 

of the data block, the method comprising the 
steps of: 

storing data indicating the layer corre- 
sponding to the last start code received in the 
30 data stream, 

continuously comparing data in the bit 
stream with a set of expected start codes, the 
set of expected start codes being selected 
responsive to the last layer, 
35 selecting one of the expected start codes 

as a detected start code based on the com- 
parison, if one of the expected start codes is 
acceptably similar to data in the bit stream, 
updating the last layer data with data in- 
40 dicating the layer corresponding to the de- 

tected start code, and 

decoding the block data corresponding to 
the detected start code in accordance with the 
detected start code. 

45 

13. A method as set forth in Claim 12 wherein the 
comparing step comprises: 

detecting start code prefixes in the bit 
stream, and 

50 comparing start codes corresponding to 

the prefixes with one or more of the expected 
start codes. 

14. A method as set forth in Claim 13 further 
55 comprising the steps of: 

suspending block data decoding if a de- 
tected start code is not selected, and 

performing error masking if a detected 
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start code is not selected. 

15. A method as set forth in Claim 14 further 
comprising the step of ceasing the error mask- 
ing and resuming block data decoding when a 5 
start code is detected corresponding to a layer 
which is the same as or higher in the layer 
hierarchy than the layer in which no selection 
was made. 

10 

16. A method as set forth in Claim 13 wherein the 
selecting step comprises: 

generating a replacement start signal if 
one of the expected start codes does not 
match the start code corresponding to the de- is 
tected start code prefix, 

selecting one or more expected start 
codes based on the last layer. 

calculating a Hamming distance of the 
start code corresponding to the detected start 20 
code prefix to each of the expected start 
codes, and 

selecting as the detected start code a one 
of the expected start codes with the smallest 
Hamming distance to the start code corre- 25 
sponding to the detected start code prefix. 

17. A method as set forth in Claim 16 wherein the 
Hamming distance calculating step includes 

the step of determining the number of bits of 30 
each of the expected start codes which do not 
match the corresponding bit of the start code 
corresponding to the detected start code pre- 
fix. 

35 

1a A method as set forth in Claim 16 wherein the 
Hamming distance calculating step for each 
expected start code comprises the steps of: 

determining for each expected start code, 
each bit of the expected start code which does 40 
not match the corresponding bit of the start 
code corresponding to the detected start code 
prefix, 

weighting each of the bits based on its bit 
position to generate a weighted bit value, and 45 
summing all of the weighted bit values. 

19. A method as set forth in Claim 13 further 
comprising the step of: 

calculating a probability of occurrence for 50 
each expected start code if no expected start 
code identically matches the start code cor- 
responding to the detected start code prefix, 
and 

selecting a one of sid expected start codes 55 
with the highest probability of occurrence as 
the detected start code. 



20. A method as set forth in Claim 12 wherein the 
selecting step comprises the steps of: 

generating a replacement start signal if 
one of the expected start codes does not 
match the start code corresponding to the de- 
tected start code prefix, 

selecting one or more expected start 
codes based on the last layer output, 

calculating a Hamming distance of the 
start code corresponding to the detected start 
code prefix to each of the expected start 
codes, 

calculating a probability of occurence for 
each expected start code if no expected start 
code identically matches the start code cor- 
responding to the detected start code prefix, 
and 

selecting as the detected start code a one 
of the expected start codes with the smallest 
value of W, where, 

W = D[Pi(L)] - E[Pi(L)] 

where 

Pi(L) is all expected start code 

D[Pi(L)] is the Hamming distance of the 

start code, and 

E[Pi(L)] is the probability of occurrence of 

the expected start code. 

21. A method as set forth in Claim 13 wherein the 
selecting step comprises the steps of: 

locally decoding block data corresponding 
to a detected start code prefix for a predeter- 
mined time period in accordance with a plural- 
ity of the expected start codes, 

detecting a number of decoding errors for 
the block data for each of the plurality of 
expected start codes, and 

selecting as the detected start code a one 
of the plurality of expected start codes in 
which the fewest decoding errors were de- 
tected. 

22. A data receiving apparatus, receiving a data 
stream where a start code, indicating a type of 
data, and corresponding data to the start code 
occur in a regular order under a prescribed 
rule, whereby a type of incoming data is ex- 
pected based on a type of data in process, 
and processing data based on a type of data 
corresponding to a start code, the data receiv- 
ing apparatus comprising: 

(a) a data supplying unit for supplying a 
data stream: 

(b) a data processing unit for processing 
data in the data stream supplied by the data 
supplying unit; 
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(c) an analyzing unit for predicting a type of 
incoming data and analyzing data in the 
supplied data stream based on the type of 
data in process, and for detecting a start 
code in a data stream, and for recognizing 5 
the type of incoming data; and 

(d) a controller for controlling the data pro- 
cessing unit based on the type of data 
recognized in the analyzing unit. 

w 

23. A data receiving apparatus of Claim 22, 
wherein the analyzing unit comprises: 

data type memory for storing a type of 
data in process; and 

start code detector for watching an incom- 75 
ing data stream and detecting a start code, for 
generating more than one type of start codes 
expected next to be detected in reference to 
the type of data stored in the data type mem- 
ory, for storing a type of data corresponding to 20 
the detected start code in the data type mem- 
ory when the detected start code matches one 
of the expected start codes, and for outputting 
the type of data corresponding to the detected 
start code to the controller. 25 

24. A data receiving apparatus of Claim 23 further 
comprises ^synchronization means for syn- 
chronizing to the data stream when a detected 
start code matches no expected start code. 30 

25. A data receiving apparatus of Claim 24 further 
comprises error masking means for masking 
an error caused by a desynchronized data 
receiving while the resynchronization means 35 
operates. 

26. A data receiving apparatus of Claim 23, 
wherein the start code detecting means com- 
prises a start code replacement unit which 40 
replaces a detected start code by one of the 
expected start codes when the detected start 
code matches no expected start code. 

27. A data receiving apparatus of Claim 23, 45 
wherein the data stream is organized in layers, 

and wherein the data type memory stores lay- 
er information of data in process. 

28. A method of receiving data comprising the 50 
steps of: 

(a) watching an incoming bit stream and 
detecting a start code; 

(b) selecting more than one type of start 
codes expected next to be detected from 55 
among a number of start code types based 

on a type of data in process; 



(c) comparing the detected start code with 
each of the expected start codes; 

(d) updating the type of data in process 
based on a type of data corresponding to 
the detected start code when the detected 
start code matches one of the expected 
start codes; 

(e) processing data based on the updated 
type of data; and 

(f) resynchronizing to the incoming bit 
stream when the detected start code match- 
es no expected start code. 

29. A method of receiving data comprising the 
steps of: 

(a) watching an incoming bit stream and 
detecting a start code; 

(b) selecting more than one type of start 
codes expected next to be detected from 
among a number of start code types based 
on a type of data in process; 

(c) comparing the detected start code with 
each of the expected start codes; 

(d) replacing the detected start code by one 
of the expected start codes when the de- 
tected start code matches no expected start 
code; 

(e) updating the type of data based on one 
of the detected start code and the replaced 
start code; and 

(f) processing data based on the updated 
type of data. 



22 



EP 0 651 584 A2 



FIG. I 




23 



EP 0 651 584 A2 





CVJ 



00 




% 

-UJ- 

cc 

GL 



5 



Q. 
O 
O 



a: 



¥ 

ZD 
O 
UJ 

to 



24 



EP 0 651 584 A2 





MACRO- 
BLOCK 


□O—l 2C 








OQ—J 


L1CE#K 




2(D 




m 










SLICE 
HEADER 
#K 



fO 
Lu 



< 
1x1 
cr 
i— 

CO 
CO 

2 



C_J CM 



lu r: 





MACRO- 
BLOCK 


CD_I 2C 








CO— i 


UJ 

o 




MACRO- 
BLOCK 
#1 


0Q_i 








0D_i 2£ 




SLICE 
HEADER 



o 

CO 
O 



_o 

O 




25 



EP 0 651 584 A2 



FIG. 4 



START CODES 


BIT STRING IN HEXADECIMAL 


PICTURE_START_CODE 

SLICE_START_CODE 

USER_DATA_START_CODE 

SEQUENCE _START_CODE 

EXTENS10N_DATA_START_CODE 

SEQUENCE_EN D_ CODE 

GROUP_START_CODE 


00000100 

00000101-000001AF 

00000 1B2 

000001 B3 

00000 1 B5 

00000 1B7 

00000 1B8 



26 



EP 0 651 584 A2 



to 




27 



EP 0 651 584 A2 



<0 
Ll 




28 



EP 0 651 584 A2 



FIG. 7 





START CODE DETECTOR 24 

t 


^15 




18 

1 














22 

1 




START CODE 




} 9 


3 

I 








IDENTIFIER 




20 
/. 






UNIQUE 


I" 
23 










r" 




PATTERN 
DETECTOR 




i 


-26 25 

/ 












START CODE PATTERN 
GENERATOR 








L 













29 



EP 0 651 584 A2 



FIG. 8 



LAYER 


START CODE OF START 
DELIMITER OF LAYER 


SEQUENCE 

GROUP OF PICTURES 

(GOP) 
PICTURE 

SLICE 


SEQUENCE _START_CODE 
GROUP_START_CODE 

PI CTURE_START .CODE 
SLICE_START_CODE 



FIG. 9 



1 



2 A 



23 

i_ 



24 

J 



START CODE IDENTIFIER 

27 



EXPECTED 
START CODE 
SELECTOR 



28 



1 



START CODE 

MATCHING 

IDENTIFIER 



19 
20 



30 



EP 0 651 584 A2 



FIG. I 0 



TABLE OF LAYER BASED 
EXPECTED START CODES 



LATEST LAYER 


EXPECTED START CODE 


SEQUENCE 


GROUP_START_CODE 
EXTENS10N_DATA_START_CODE 
USERJDATA _START_0ODE 


GOP 


PICTURE.START.CODE 
EXTENSION_DATA_START_CODE 
U SER_DATA_START_CODE 


PICTURE 


SUCE_START_CODE 

EXTENSI0N_DATAJSTART_C0DE 

USER_DATA_START_CODE 


SLICE 


SL1CE_START_C0DE 
PICTUR E_START_CODE 
GROUP_START_CODE 
SEQU E N CE _START _CODE 
SEQUENCE.END _CODE 



31 



EP 0 651 584 A2 



Sir in 



cr 

LU 

9 < 

< i — 

LU < 

X Q 



CE 111 
< Q 
O 

to o 



32 



EP 0 651 584 A2 



LU-— 

in** 




CM 



< 
UJ 

IT) 



GQ 

O 
LU 
Q 



O 
LU 
Q. 



J** 
CO 



LU 
- Q 

Q<°i 3?2 



CM 



LU 

S8ff 

o 



LU LU 
Q 

^ 2oz8 



~8 




•a 



O 

5 ° 



LU 

■o- 

LU 
3 

a 

UJ 



UJ 

to 



LU- 



LU- 



5 

y a: 



C/V 



o^ 1 



o._ 



h- o 
too 

..2 

fsl 
Z 

a 
oc 
x 
o 

i 

Ui 

cr 



LUUJ 

crto 



cro 



tno 
uja: 
a: cd 



— UJ 

88 
►=<-> 




© 



z 
o 

UJJOLU 

cruj 

UJO 



33 



EP 0 651 584 A2 



FIG. I 3 



FLOWCHART OF START CODE DETECTION 
( START > S1 



INITIALIZATION — S2 



WATCH INCOMING 
BIT STREAM 




SEQUENCE 
END CODE 



<END) 



S4 



SELECT EXPECTED START 
CODES BASED ON LATEST 
LAYER INFORMATION 



-S6 




S10 



RESYNCHRONIZATI ON 



STORE LAYER INFORMATION 
IN LAYER MEMORY 



-S8 



INFORM CONTROLLER 



-S9 



34 



EP 0 651 584 A2 



FIG. 14 

FLOWCHART OF RESYNCHRONIZATION 
( START ^) -Sn 

-SI 2 



SUSPEND DECOOING 



START ERROR MASKING —51 3 



SET START CODE AS SIGNAL 
FOR SYNCHRONIZATION BASED 
ON ERROR DETECTED LAYER 



WATCH INCOMING 
BIT STREAM 



-S15 




END ERROR MASKING | 






RESUME 


DECODING 



-S18 



T 

( END > S19 



35 



EP 0 651 584 A2 




EP 0 651 584 A2 



CO 



CO 
Ll. 



LU 
LU 

a 

-j 

Q_ 
LU 

cr 

LU 
Q 

8 



QC 
01 



c*v 



CM 
CO" 



>: Wcr 

<Q< — 

^ to a. 

COCQGCSd 



CO 



do 
coo 



CNI 



oo 

~CSJ 



LU 
LUOO 



XPUJ 
LU (/)(/) 



2"— 



CO 
CM 



°- ! 



CO 

cm 



37 



EP 0 651 584 A2 



FIG. I 7 

32 



1 





SIMILARITY CALCULATOR 
^35 ^36 




28 

) 


















XOR 




NON-ZERO 




33 
J . 


23 

1 




CALCULATOR 




BIT COUNTER 





























38 



EP 0 651 584 A2 



FIG. I 8 



FLOWCHRT OF START CODE DETECTION 



C START > ~S1 
INITIALIZA TION \ ^S2 



I 



WATCH INCOMING 
BIT STREAM 




S3 
S5 

SEQUENCE 
END CODE 



SELECT EXPECTED START 
CODES BASED ON LATEST 
LAYER INFORMATION 



-S6 




< END ) 

S4 



1 



520 



REPLACEMENT OF 
START CODE 



STORE LAYER INFORMATION 
IN LAYER MEMORY 



S8 



INFORM CONTROLLER 



39 



EP 0 651 584 A2 



FIG. I 9 

FLOWCHART OF START CODE REPLACEMENT 
C START > ~S21 



I_ L 



S22 



CALCULATE CODE DISTANCE 
BETWEEN DETECTED START CODE 
AND EXPECTED START CODE 



S23 



SELECT START CODE OF THE 
SMALLEST VALUE IN CODE 
DISTANCE 



S2A 



REPLACE DETECTED START CODE 
WITH SELECTED START CODE 



( END > ~S25 



40 



EP 0 651 584 A2 



en 

s 



cn 



o 



LU 



CL 
LU 



8 

l— 
CC 



cn 



LUrr 



o 



Q- CQ CT~ 



00 
CO" 



Oo 
£L<2 



GO 
"CM 



Ixl 

q8oc 
woo 

I— f~ 
Q_<— l 

><Puu 

LUCOtO 



CO 

CM" 



co 



cn^v 1 



41 



EP 0 651 584 A2 



FIG. 2 I 



18 

J_ 



28 



PRIORITY ASSIGNING NUMERATOR 

L 



37 

JL 



AO 



EVALUATION MEMORY TABLE 



LATEST LAYER 



EXPECTATION VALUE 
(PROBABILITY) OF 
"OCCURRENCE OF LAYER ~ 
BASED EXPECTED START CODE 



38 



42 



EP 0 651 584 A2 



CM 
CM 



UJ 
—1 

< 



cc 
o 

UJ 



5< 
UJ 



o 



UI 

UJ 

u 
z 

UJ 

cc 
cc 

S3 
58 



oo «- *- 



UJ 
Q 

8 

UJ CO 

So 



cc 

UJ 

5 



tn 

UJ 



(O (M N 



UI 
Q 

8 

I 

CC 
< 



UI 

8 

o 

£ Q 

5 o 



to. 



< 

Q 
I 



I 

t— 
CC 



_ Z £ 

in Q !« 

a. 1 g °, 
3 m cc 

Sh UJ 
X CO 
O UJ D 



UI 

o 
z 

UI 

a 

UI 

m 



CO CM CM 



UJ 

a 

cc ° 



ui 2 

Q_ UI 



O 

cc 

a 
i 

cc 

UI 

in 
3 



a_ 
o 
o 



ui 
a 
o 

CJ 



o 
o 



cc 
< 



cc 
< 



I UJ 

a 
o 
o 



< 

Q 
I 



I 

l — 
CC 



in Q < 

i m Q , 

UJ z ' 

a & E 

—i x in 

ifl uj r 



CM CM CM Csl CM 



UJ 
CC 

3 
U 
CL 



UJ 

8 ^ 
IU H Q 

Q °,0 
< £ 

in ui , 

i * CL 
UI 3 3 

y ^ o 
□ y cc 

m Q_ o 



UJ 
Q 

O UI 

O Q 

I o 

t- o 

^ z 

^ ui 

UI UJ 



I 



UI UI 

3 3 

a a 

UJ ui 

in to 



UJ 

o 

_J 

in 



43 



EP 0 651 584 A2 



ro 

CM 



LU 
_l 
CO 
< 



>■ 

cc 

2 

UJ 



§ 

3 
_l 



UJ 

J" 

> LU 
LU O 



LU 

a 
o 
o 

t— 
cc 
< 
i— 

CO 



<Q 
CD LU 

m 

_JUJ 



cr 

LU 

5 



LU 



o o 



LU 

a 
o 
o 
. i 



LU 
Q 



LU 
Q 
O 
O 
I 



18 



CD 



a 



tr 

£ z 

to o 

o £ 

CC X 

CD LU 



LU 
O 
Z 
LU 
3 

a 

LU 

cn 



cc 



< 
cc 

LU 

to 

3 



o o o 



LU 

a 



8 



LU 

a 
o 



cc 
< 



I LU 
O 

o 



to. 



J- < 



cc 

3 

I 

LU 
CC 
3 
I— 
O 

Q_ 



< 
Q 
I 



I 

i — 
CC 

to 
i 



o !< 
■< to 

LU 3 



CL 
O 
O 



O o O 



LU 

a 

8 

I 



LU 

a 

5 

< 



LU 
Q 
O 



< 



CC 

£ z' 

In Q 

lu'z 1 

CJ LU 

□ >< 

CO LU 



to. 



< 

a 
i 

cc 

LU 

s 



LU 
CC 
3 
»— 
O 

QL 



N N N (VI (M 



LU 

9 LU 



8 ,s 

J o 



LU 

a 

°, | _' 

t is 

< K ? 

1 § % 



LU 

a 

8 

I 



LU 
O 
O 



UJ — _ 

s=2 r; o 

□ cc 

- a o 



CO 



cc 
< 



CO qj 

I I 

LU LU 

O O 

z z 

LU LU 

3 3 

O O 

LU LLJ 

Lo CO 



LU 
O 

CO 



44 



EP 0 651 584 A2 



CVi 
li_ 



UJ 

-j 
m 
< 



o 

UJ 



< 

_l 
lli 



UJ 

2- Lli 
2cr 
<o 

LU O 



UJ 
Q 

8 
ir 

< x 

_l LU 



cr 



CO M O 



111 

Q 
O 
O 



UJ 



UJ 
Q 
O 
U 
J 

cr 
a. 1 



UJ 

o 



s 

s 

in 



I UJ 

a 

8 

In J 
i 

s 

i 

o 



< 
a 
z I 
UJ cr 
I — UJ 
X I/) 
UJ 3 



CO <n O 



UJ 

o 



8 



UJ 

a 

8 



•a 

o 
o 
I 



cr 

UJ 

cr 



o 

Sl 



O 
I 



o 5 

g Q 

lu cr 

£ UJ 

x in 

ui 3 



cr 

3 



O 
O 



CO N O 



UJ 

o 
o 

o 



cr 

In Q 

I if) 

uj z 

_ X 

cn ui 



UJ 

o 
o 

|8 
< cr 

Q .3 



CSI CSI CN4 CN( CM 



3 

cr 

UJ 

m 



ui 
cr 
z> 
t— 
o 

5! 



UJ 

o lu 

LU O Q 

8 j 8 
2 | -' 

I «. 2 

»— • CO 

i cr q_ 

UJ D D 

y £ o 
□ ^ cr 
m 5. o 



UJ 
Q 

O LU 

CJ Q 

• O 

cr il 

iS § 

UJ UJ 

z ° 

UJ UI 

Z) 3 

O O 

LU UJ 

in m 



Ui 

o 

_l 

m 



45 



EP 0 651 S84 A2 



cr 

LU 
Q 

cr 
o 



cr 
o 

E 
o. 



UJ 
Q 

o 
o 



cr 

13 



to 

LU 



«— cm co 



LU 
Q 

8 



LU 

i< 8 
1 £ 



- ^ 

cr Q 



J 2 
in Q § 

_ i i75 q 



.< _ 
O 

Q_' j| , 

uj tr 

' 8i 



s 2 



LU 
CJ 

o 

LU 

to 



— CNI CO 



LU 



LU 
Q 
O 



C LJ 

8 18, 

fe $ iS 

< Q <A 



^ cn n 



I 

LU 



I 

U 



a 

in Q ( 
Lu pc 

1= LU 

>< to 

LU 3 



Q_ 

o 

CD 



LU 
Q 

3 

cr 
lu < 

cn o 

i Lo 

LU Z 
O LU 

CO LU 



LU 
O 
O 

°. 

cr 



i 

cr 

LU 

to 



LU 

cr 

I — 
CL 



LU 
Q 
O 



cr 

m 
i 

LU 

o- 

—I 

(O 



LU 

Q LU 
8 

I-' O 

< cr 
w i 

£ CL 
2 3 

y cr 

CL. O 



LU 
Q 
O 
O. 



LU 
Q 
O 
O 
I 

I— 

cr 

S _ 

LU LU 
O O 

LU LU 

o a 

LU LU 

to to 



LU 
O 

_J 

to 



46 



EP 0 651 584 A2 



o 



CO 
CVJ 

IJL 



z 

Z) 



LU 
CJ 
< 

0_ 
LU 

OC 

LU 
O 
O 
O 

I— 



LUrr 
trS 



^ 

ccoLu 

Sins 
cr i/) z> 

0_<Z 



00 
CM' 



CM 



CO 
C*V 



el 

too 



CO 



UJ 



00_ 



CO 
CM" 



co> 



T 

i 



CO 
CM 



47 



EP 0 651 584 A2 



FIG. 27 



38 

_L 



33 

A 



REPLACEMENT IDENTIFIER 
42 

(_ 



WEIGHT 
COEFFICIENT A 
MULTIPLIER 



0- 



43 



WEIGHT 
COEFFICIENT B 
MULTIPLIER 



41a 

_L_ 

44 

_L 



REPLACEMENT 
EVALUATOR 



19 



20 



48 



EP 0 651 584 A2 



00 
CM 

CD 

Ll 



err 




49 



EP 0 651 584 A2 



♦ 2- 



O 

CM- 



z> 



UJ 

2 

UJ 

_J 
Q_ 
LU 

cr 

LU 
Q 

8 

I — 
OH 



o 

s >■ 




DECOC 

TIME 

MEMOF 





CO 



LuyJ 

UJ3T 

era 



LU CC 
LU Q_ 



Q__ 



CO 



c*v 



(752 
a. <z 



cr 
o 



ao 

CM' 



t6 
cm 



CO 
CO" 



>. cr 
cr < 

CD O 



CM 
CO 



a 



8g 



oo 



CO 



o 

CO 



CO 
CM" 



50 



EP 0 651 584 A2 



FIG. 30 



TABLE OF DECODING 
TIME 



LAYER 


TIME PERIOD (ms) 


SEOUENCE 


10 


GOP 


5 


PICTURE 


A 


SLICE 


2 



51 



EP 0 651 584 A2 




52 



EP 0 651 584 A2 



FIG. 32 

FLOWCHART OF REPLACEMENT CONTROL 
( START V S31 




REFER TO ERROR INFORMATION 49 
IN CONTROLLER 10 




OUTPUT CONTROL SIGNAL 
TO START REPLACEMENT! 
TO SWITCHES 60 



C END ^) 





f / S3? 


OUTPUT ERROR MESSAGE 
(STEP PROCEEDS TO 
RESYNCHRONIZAT1 ON ) 



53 



EP 0 651 584 A2 



LU 
Q 

O 
O 



I 

Q 
LU 

O 
LU 
CL 
X 
LU 



LU 
Q 

8 

I 

I — 

CO 

I 

LU 
CJ 

z 

UJ 

3 

a 

in 

i 



LU 
Q 
O 
CJ 
I 



LU 

a 

8 
3 



QC 

in 



LU 

o 
o 
o 
i 

qE 
i< 

in ..; y 



i 



cr 

LU 

5 



LU 



LU 
CJ 

z 

LU 

z> 

s 

in 



• o 
2 3 



o 

CL 



X 
LU 



S 

00 
ZD 

a 

LU 

cr 

I 

cr 

? LU 
< I — 

Q X 

LU 2 

m 

3 Z 



LU 

a 
o 
u 
i 



g5 



8 



LU 
Q 

»8, 



'I 



cr 



cr 
i i 



z < 



cr ^ 



p lu cr 

O h LU 

s x m 

CL LU ZD 



a. 
o 
o 



LU 
O 

8 

I 

I— 

cr 

g 

i 

LU 

cr 



o 

CL 



2 



LU 
O 
O 
O 
I 

I— 

cr 
< 



8. 



& 



cr 
£ z 
S2 

m Z 

!j x 
in lu 



a 

LU 

cr 

§ 

cr 

LU £ 
O 

3 g 

cr 

g 2 
g £ 

I UJ 
LU CD 

in . 



ZD 

f- 

CJ 
CL 



LU 

a 
o 
o 
i 

i— 
cr 
< 



LU 

O LU 

8,8 



cr 



cr 



in lu 
i cr 

LU ZD 
° O 

n y 8 

m q_ o 



CL 
3 



LU 

8 « 

is 

in uj, 

LU LU 
CJ U 

z z 

LU LU 
3 3 

o o 

LU CD 

in in 



LU 
CJ 

m 



54 



EP 0 651 584 A2 



FIG. 34 



MPEG1 SYSTEM BIT STREAM 



PACK START CODE [^FACK END CODE 




PACKfli 1 




PACKfli 




FACKfln 



PACK 




FACKET 





PACK SYSTEM 
START CLOCK 
CODE REFERENi 




SYSTEM HEADER 




SYSTEM HEADER 
START CODE 



PACKET 




PACKET DATA 
(VIDEO, AUDIO, ETC.) 



PACKET START CODE (INCLUDING DATA 
TYPE INFORMATION ) 



55 



EP 0 651 584 A2 



FIG. 35 



LATEST LAYER 


EXPECTED START OODE 


PACK 


SY STEM_ HE ADER_START _CODE 
PACKET.. START .CODE 


SYSTEM HEADER 


PACKET START _CODE 


PACKET 


PACKET_START_CODE 
PACK_START JCODE 
PACK_END JCODE 



56 



EP 0 651 584 A2 



FIG. 36 



(a) 



SI 



S2 
S3 
SA 



SI 




(O SI 



- S 2 

- S3 

- S A 

1 — S5 



S1 



S6 
S7 



57 



EP 0 651 584 A2 



FIG. 37 

CONVENTIONAL ART 



BIT PATTERN 
COMPARATOR 



54~ 



52 



53 

J_ 



START CODE 

PATTERN 

GENERATOR 



FIG. 38 

CONVENTIONAL ART 



0-BIT ERROR 


11010 


1-BIT ERROR 


01010 




10011 




11110 




11000 




11011 



58 



